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ABSTRACT 


Many  results  for  statistical  investigations  are  valid  for  more  general  models 
than  were  used  in  their  development.  This  is  the  case  for  situations  where  indepen¬ 
dence  (or  zero  correlation) ,  equal  variances,  and  sometimes  joint  normality  are 
assumed  for  sets  of  random  variables.  This  research  investigates  extended  uses  of 
standard  results  for  some  analysis  of  variance  situations.  Many  methods  are  found 
to  be  usable  with  much  more  general  models,  alt!  jugh  not  all  types  of  effects  can 
be  investigated.  The  research  also  provides  investigation  methods  that  are  usable 
for  all  the  effects.  Moreover,  the  extended  models  associated  with  these  methods 
are  much  more  general  than  those  for  the  standard  methods.  Chapter  £  is  intro¬ 
ductory  and  includes  a  statement  of  the  concepts  involved.  Material  m  Chapter  II 
shows  that  some  of  the  results  assuming  a  sample  from  a  normal  population  are 
applicable  more  generally,  including  some  methods  for  one-way  analysis  of  variance. 
The  remaining  chapters  are,  with  one  exception,  concerned  entirely  with  analysis  of 
variance.  Chapter  III  contains  some  extended  uses  of  standard  results  for  fixed- 
effects  models.  Chapter  IV  gives  extended  uses  of  standard  results  for  models 
with  random  effects.  Chapter  V  contains  metl^s  for  investigating  all  effects, 
for  some  models  with  fixed  effects.  Chapter  VI  is  concerned  with  investigating  all 
effects  and  models  with  random  effects.  Finally,  an  analysis  of  covariance  model 
and  a  mixed  model  are  considered  in  Chapter  VII. 
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CHAPTER  I 

INTRODUCTION 

Mode Is  for  observed  data,  in  terms  of  parameters  and  unobserved  random 
variables,  provide  the  basis  for  investigations  of  an  analysis  of  variance  (ANOVA) 
nature.  The  customary  models  utilize  some  stringent  assumptions,  which  include 
e<yial  variances  within  sets  for  the  unobserved  random  variables  (perhaps  for  all 
such  ramtam  variables)  and  zero  correlation  among  most  or  all  of  the  unobserved 
random  enables.  -Sometimes,  joint  normality  for  the  unobserved  random  variables 
is  also  a rmcmert  (when  something  besides  point  estimation  is  desired) . 

Many  methods  for  statistical  investigation  are  applicable  for  more  general 
models  than  those  on  which  their  development  was  originally  based.  The  research 
reported  here  identifies  extended  models  for  which  some  standard  ANOVA  type  methods 
remain  applicable.  These  extended  models  are  substantial  generalizations  of  the 
original  models.  However,  no  extension  occurs  wherein  all  of  the  types  of  effects 
can  be  investigated  by  use  of  standard  methods. 

To  obtain  investigation  methods  for  all  the  types  of  effects,  and  to  be  able 
to  use  extended  models  of  a  much  more  general  nature,  some  statistical  methods 
different  from  those  customarily  used  are  developed.  This  is  accomplished  by 
replacing  the  usual  "sum  of  myiares  for  error"  by  another  statistic  that  has  similar 
properties  but  fewer  "degrees  of  freedom. " 

An  extended  model  is  obtained  by  adding  one  or  more  unobserved  random  terms  of 
an  error  nature  to  the  original  model.  The  kind  of  terms  added,  and  conditions 
they  are  required  to  satisfy,  depend  on  the  types  of  effects  that  are  to  be  inves¬ 
tigated  simultaneously .  An  effect  investigated  is  a  parameter  in  the  model  or, 
for  random  effects,  is  a  variance  (or  covariance,  or  function  of  variances  and/or 
covariances)  of  the  type  of  unobserved  random  effects,  in  the  original  model, 
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being  considered.  There  is  no  interest  in  properties  of  the  extra  random  error (s) 
that  are  added  to  the  original  model  to  form  the  extension. 

The  generality  level  for  an  extended  model  depends  on  the  types  of  effects 
to  be  investigated  simultaneously.  Foi  the  extensions  given,  the  generality  level 
is  much  higher  for  a  subset  of  a  set  (of  types  of  effects)  than  it  is  for  the  set 
itse If . 

A  requirement  in  the  development  of  an  extended  model  is  that  the  additional 
error  term(s)  must  not  occur  in  any  of  the  statistics  used  for  the  investigation 
methods.  That  is,  the  extensions  are  motivated  by  the  statistics  to  be  used.  Two 
ways,  m  combination,  are  applied  to  eliminate  the  extra  error  terms  from  statistics. 
First,  these  errors  ran  be  exactly  cancelled  out  in  the  statistics.  Second,  one  or 
acre  summation  conditions  are  imposed  that  cause  these  errors  to  be  eliminated. 

The  summation  conditions  reduce  the  level  of  generality  obtained  from  the  presence 
of  the  additional  errors  but  much  of  '-his  generality  remains.  For  example,  the 
requirement  that  ten  random  errors  sum  to  a  constant  effectively  leaves  nine  un¬ 
constrained  random  error  terms.  Since  all  additional  random  errors  are  eliminated, 
the  statistics  have  the  same  probability  properties  for  the  extension  as  they  do 
for  the  original  model.  In  particular  this  is  the  case  when  the  joint  normality 
assumption  occurs  for  the  original  model. 

To  be  emphasized  is  that  the  total  interest  is  concentrated  on  investigation 
of  the  effects  that  occur  for  the  original  model.  Any  additional  random  error 
term  is  a  further  >.rror  contribution  from  the  experimental  situation  (and  ideally 
would  be  zero)  . 

Also  to  be  emphasized  is  that,  subject  to  any  summation  conditions  imposed, 
the  additional  random  error  terms  can  have  an  arbitrary  joint  distribution.  That 
is,  they  can  have  any  goint  distribution  that  is  possible.  Moreover,  the  addition¬ 
al  errors  can  have  any  permissible  dependences  with  the  unobserved  random  terms  in 
the  original  model. 
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When  only  one  extra  error  term  occurs,  it  can  have  an  arbitrary  distribution  and 
any  permissible  dependences  with  unobserved  random  variables  in  the  original  model. 

Thus,  an  extended  model  is  able  to  at  least  approximate  a  broad  class  of  joint 
distributions  for  the  observations.  Results  obtained  for  an  extended  model  are 
exact  when  some  one  of  the  possibilities  for  the  extended  model  exactly  represents 
the  joint  distribution  of  the  observed  random  variables.  Approximate  results 
occur  when  an  approximate  (but  not  exact)  representation  is  obtainable. 

These  considerations,  and  the  research  performed,  show  that  many  of  the 
standard  results  for  models  of  an  ANOVA  nature  have  "robustness"  properties.  That 
is,  for  the  models  considered,  many  of  the  effects  investigated  for  the  original 
model  are  sti.il  investigated,  with  the  same  probability  properties  as  for  the 
standard  methods,  when  additional  error  terms  of  a  rather  general  nature  can  be 
present.  Moreover,  modified  investigation  methods  combined  with  further  research 
show  that  (for  the  models  considered)  all  effects  can  be  investigated  and  with 
stronger  robustness  properties  than  for  the  standard  methods. 

The  first  material  presented  (Chapter  II)  considers  extensions  for  the  cases 
where  a  random  sample  from  a  normal  population  is  originally  assumed,  and  for  the 
case  where  the  several- sample  normality  model  for  one-way  ANOVA  is  originally 
assumed.  Standard  methods  are  considered  for  both  cases.  This  first  material  is 
given  in  greater  detail  than  for  other  cases  using  standard  methods,  in  order  to 
introduce  the  cancellation  way  of  eliminating  the  extra  error  terms. 

The  second  material  (Chapter  III)  considers  extensions  of  models  with  fixed 
effects  for  use  of  the  standard  methods.  Two-way  ANOVA  with  no  replication  and 
two-way  ANOVA  with  replication  (interactions  included)  are  the  two  cases  examined. 
Some  results  of  this  nature  are  also  given  in  Chapter  V  (for  presentation 
convenience) . 

The  third  set  of  material  (Chapter  IV)  is  concerned  with  the  extensions  of 
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random-effects  (variance  components)  models  and  use  of  the  customary  methods. 


Considered  in  somewhat  general  terms  are  various  types  of  variance  components  mode.. 
Considered  in  detail  is  two-way  ANOVA  with  no  replication. 

Chapter  V,  containing  the  fourth  se  of  material,  considers  extensions  of 
fixed-effects  models  and  some  new  investigation  methods.  Here,  all  effects  can  be 
investigated.  One-way  ANOVA  and  two-way  ANOVA  with  replication  (and  interactions) 
receive  consideration.  More  detail  than  usual  (for  cases  with  new  methods)  occurs 
here,  in  order  to  introduce  the  summation  way  of  eliminating  extra  error  terms. 

The  fifth  material,  in  Chapter  VI,  is  concerned  with  extensions  of  random- 
effects  models  and  presents  some  new  methods  that  can  be  used  to  investigate  all 
effects.  One-way  ANOVA  and  twofold  nested  ANOVA  are  considered. 

Finally,  in  Chapter  VII,  some  results  for  one-way  analysis  of  covariance  and 
for  the  Scheffe  two-way  mixed  model  for  ANOVA  are  presented.  Standard  methods  are 
considered  for  the  analysis  of  covariance  case,  and  re-'.  :d  s  are  given  for  the 

mixed  model  case.  All  effects  can  be  investigated  ::r  t re  mixed  model  case. 

In  addition  to  the  basic  investigation  results,  several  methods  have  been 
developed  for  rejection  of  outlying  observations.  For  brevity,  these  methods  are 
not  presented  in  all  cases.  However,  to  illustrate  the  approach  used,  a  few  of  the 
methods  are  given  in  detail.  Also,  other  places  where  such  a  method  has  been  de¬ 
veloped  are  identified  by  specification  of  the  mo^t  general  extension  (of  the  type 
considered)  for  which  the  rejection-method  is  applicable. 

Lastly,  some  notation  properties  are  stated.  This  notation  involves  tnt  use 

of  a  dot  in  place  of  a  subscript  for  an  observed  variable  (random,  or  fixed  as  in 

the  ai-alysis  of  covariance)  .  Use  of  a  dot  in  place  of  a  subscript  implies  that 

the  quantity  considered  is  the  arithmetic  average  of  the  variable  over  all  values 

of  this  subscript,  for  the  specified  values  of  the  other  subscripts.  For  example, 

consider  y.  ,  where  i  =  1,  ...,  I;  j  =  1,  ...,  J;  k=l,  ...»  K. 
igk 
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yi3. '  J/iJ)/*'  ».  -k  ■  £  E  • 


I  J  K 

E  E  E  y  /IJK. 
i*l  j=l  k*l 


This  notation  property  is  used  throughout  Chapters  II  -VII.  Also,  the  way  of 
representing  equation  numbers  and  numbers  for  AN OVA  type  models  is  selfcontained 
within  each  part  that  begins  0.  SUMMARY,  or  begins  0 .  Summary.  That  is,  the  num¬ 
bering  used  applies  only  within  this  part. 


CHAPTER  II 


EXACT  NORMALITY-SAMPLE  RESULTS  FOR  DEPENDENT  OBSERVATIONS 
FROM  NONNORMAL  POPULATIONS 


0 .  SUMMARY 

Some  well-known  statistical  results  are  based  on  the  assumption  of  a  random 
sample  from  a  normal  population  or,  for  one-way  AN OVA ,  the  assumption  of  indepen¬ 
dent  samples  from  normal  populations.  Many  of  these  tests,  confidence  regions,  etc. 
have  the  same  properties  when  less  stringent  assumptions  are  made  (and  the  inves¬ 
tigation  is  suitably  interpreted) .  That  is,  a  generalization  can  be  made  of  the 
concept  of  a  sample  from  a  normal  population  and  of  the  concept  of  independent 
samples  from  normal  populations.  These  generalized  models  permit  dependence  among 
some  or  all  observations  and  each  observation  can  be  from  a  different  nonnormal 
population.  Exact  results  are  obtainable  when  the  statistic (s)  used  can  be  expressed 
entirely  in  terms  of  differences  of  observations.  For  the  situation  corresponding 
to  the  one- sample  case,  such  statistics  occur  for  variance  investigation  and  rejec¬ 
tion  of  outliers.  Some  statistics  of  this  nature  occur  for  the  situation  corre¬ 
sponding  to  one-way  ANOVA,  including  the  ^-statistic  often  used  to  test  whether 
independent  samples  are  from  the  same  normal  population. 

1.  INTRODUCTION  AND  RESULTS 

A  common  assumption  is  that  the  data  are  a  random  sample  from  a  normal  popula¬ 
tion  or,  for  one-way  ANOVA,  are  independent  samples  from  normal  populations.  More 
specifically,  for  the  one-sample  case,  the  observations  can  be  expressed  in  the  form 

xi  ■  4  +  ei#  (i  "  1  ,. . . , n)  , 

where  the  e^  are  a  random  sample  from  a  normal  population  with  zero  mean  and  posi- 
2 

tive  variance  a  (ordinarily  unknown) .  For  the  one-way  ANOVA  case,  the  observations 
can  be  expressed  in  the  form 
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xij  “  uj +  eij'  u " 1 . n<j),  j  “ 1 . *] ' 

where,  for  fixed  j,  the  e_  are  a  random  sample  of  size  n(j)  from  a  normal  popu- 

2 

lation  with  zero  mean  and  positive  variance  a (ordinarily  unknown) .  Also,  thr 
are  mutually  independent. 

The  purpose  of  this  material  is  to  show  that  many  of  the  results  developed  on 
the  basis  of  these  normality -sample  assumptions  remain  exact,  and  have  the  same 
properties,  when  the  forms  used  for  the  observations  are  generalized. 

Corresponding  to  the  one-sample  case,  the  observations  are  expressed  in  the 

form 


xi  *  n  +  eA  +  e* ,  (i  *  1, . . . ,n) , 

where  the  e^  have  the  same  properties  as  for  the  normality-sample  situation  and 
e’  has  an  arbitrary  distribution.  Also,  e‘  can  have  any  allowable  dependence  with 
the  and  the  level  of  dependence  can  vary  with  i.  If  the  variances  and  covari¬ 
ance  exist  for  (e',e, ,...,e  ),  with  positive  variance  for  e' ,  and  p.  denotes  the 

xn  i 

correlation  between  e'  and  e.,  the  condition 

l 

p.2  +  ...  +  p  2  s  1  (1) 

i  n 

must  be  satisfied  by  the  p^. 

The  interest  is  still  in  the  properties  of  the  population  yielding  the  e^, 
with  no  interest  in  properties  that  involve  e'.  The  value  of  e'  represents  an 
error  contribution  imposed  on  all  the  observations  by  the  experimental  situation 
(and  ideally  would  be  zero) ,  with  different  e^  possibly  having  a  different  in¬ 
fluence  on  the  random  value  occurring  for  e*.  The  x^  have  continuous  distributions, 
since  the  e^  have  continuous  distributions,  and  have  the  same  population  mean 
(when  the  expected  value  of  e'  exists) .  Since  the  distribution  of  e.  +  e'  is  in¬ 
fluenced  by  the  dependence  between  e^  and  e',  the  x^  can  have  noticeably  different 
nonnormal  distributions.  Also,  any  two  are  virtually  always  dependent,  and  the 
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level  of  dependence  can  be  high.  A  special  case  is  that  where  the  x^  are  normal 

nultivariate  and  the  correlation  between  every  two  x^  is  the  same.  Properties  of 

some  well-known  results  for  this  case  are  examined  in  Walsh  (1947) .  As  is  shown 

in  the  verification  section,  the  model  for  the  x^  used  here  is  equivalent  to  that 

of  Walsh  (1947)  for  the  case  where  (e',e,,...,e  )  have  a  normal  multivariate  dis- 

1  n 

tribution  and  the  0^  are  equal.  The  generalized  form  used  for  the  x^,  also  the  form 
given  later  for  the  x_,  are  specializations  of  the  form  introduced  in  Walsh  (1968) 
for  two-way  ANOVA. 

When  a  statistic  can  be  expressed  entirely  in  terms  of  differences  of  the  x^, 
the  contribution  e'  cancels  out  and  the  statistic  has  the  same  properties  as  when 
the  normality -sample  assumptions  hold.  As  an  example,  for  n  ^  2, 

2  "  -  2  n 

s  =  E  (x.  -  x)  ,  with  x  =  E  x./n 

i*l  1  i*l  1 

identically  equals 


_  2  - 

E  (e.  -  e)  ,  with  e  =  E  e./n. 

1-1  1=1 

2  2  2  2 
Hence,  s  /a  has  a  X  -  distribution  with  n  -  1  degrees  of  freedom  and  s  /(n-1)  is 

2 

an  exactly  unbiased  estimate  of  a  .  Also,  procedures  for  rejection  of  outlying 
observations  almost  always  are  based  on  differences  of  the  sample  values  (for 
example,  see  Quttroan  and  Smith  (1969) ,  and  the  references  listed  therein) . 

Next,  consider  the  form  of  the  observations  for  the  situation  that  corresponds 
to  one-way  ANOVA  for  two  or  more  samples.  Here, 

x^  =  Uj  +  +  e",  [i  “  l,...,n(j);  j  =  1  . . .  ,m] , 

where  the  e„  have  the  same  properties  as  for  the  normality- sample  case  and  the 
distribution  of  e"  is  arbitrary.  Also,  e'*  can  have  any  permissible  dependence 


with  the  e 


and  the  level  can  vary  with  the  value  of  (i,j)  . 


When  variances  and 


8 


covariances  exist  for  (e"  ,es  ^  ;i*l, . . .  ,n(  j) ;  p^..  denotes  the  correla¬ 

tion  coefficient  for  e''  and  e. the  condition 

1-3 


tn  n  ( j) 

s  r  p  2  *  i 

j*l  i  =  1  i:i 

is  necessarily  satisfied  by  the  P^. 


(2) 


The  only  interest  is  in  the  properties  of  the  populations  from  which  the  e„ 
are  obtained.  The  value  of  e' 1  is  an  error  contribution  that  ideally  would  be  zero. 
The  null  hypothesis  considered  is  the  same  as  for  the  normality  sample  case.  That 
is,  the  null  hypothesis  asserts  that  the  e^  +  Uj  are  from  the  same  normal  popula¬ 
tion.  In  view  of  this  null  hypothesis,  and  reasons  for  its  investigation,  consider¬ 
ation  of  the  case  where  all  observations  receive  the  contribution  e*'  seer  to  be 
an  appropriate  generalization  of  the  form  of  the  observations  for  one-way  ANOVA. 

The  distributions  of  the  x^  are  continuous  but  can  be  nonnormal  and  noticeably 
different.  Any  two  x„  are  virtually  always  dependent,  and  this  dependence  can  be 
very  strong. 

The  contribution  e''  cancels  out  for  any  statistic  that  can  be  expressed  en¬ 
tirely  in  terms  of  differences  of  the  x„  .  In  particular,  aippose  that  all 
n(j)  i  2  and  consider  the  F-statistic  often  used  to  test  whether  independent  samples 
are  from  the  same  normal  population.  Under  the  null  hypothesis,  the  +  e_  are 
from  the  same  normal  population,  so  that 


V 


m  n(  j)  _  m  n(j)  _ 

Z  I  (s..-x)  s  Z  Z  (e..-e)  » 

j*l  i*l  3  j*l  i*l  J 


a  -  -  2  m  -  -  2 
Z  n( j)  (x  .  — x)  ■  Z  n(j)  (e  ,-e)  , 

j-1  °  3-1  '2 


where 


9 


10 


r  r- 


with  oQ  being  the  variance  of  e'.  Expansion  shows  that  its  value  is 

2  2n 2  2 

a0a  (1-Pl  -...-pn  ), 


which  is  necessarily  nonnegative. 

Next,  consider  verification  of  Equation  (2)  for  the  situation  corresponding 
to  the  one-way  AN OVA  case  where  the  variances  and  covariances  exist  for 

,n(j) ;  j“l,...,m)  and  all  variances  are  positive.  The  determinant 
of  the  variance-covariance  matrix  for  this  multivariate  random  variable  is 

2 


<e,,»ei3;  i=1* 


00 


011^00°! 


P11CT00CT1 


Pn  (m)  mCT00CTm 


Pn(m)mP00Pm 


0 


with  ctq0  being  the  variance  of  e''.  The  value  of  this  determinant  is 


2  2nd)  2n(m) 
°00  CT1  *°m 


which  is  necessarily  nonnegative. 


E">  n(j)  ,*1 

-  A  A  J  ’ 


Finally,  suppose  that  (e1 ,e^, . . . ,e  )  has  a  normal  (n4-l)  -variate  distribution 


2  2 

with  ctq  and  a  positive  and 


pi'  ••• 


Then  the  correlation  between  any  two  x^  is  the  same  and  can  be  expressed  as 


(c02+pcr0c7)  /  (a02+c2+2pa0o)  . 


(3) 


the  model  here  for  the  one-sample  case  is  equivalent  to  the  model  in  Walsh  (1947)  if 
the  value  of  (3)  can  be  shewn  to  take  all  values  from  - (n-1) to  1.  Since  (3)  is 


11 


*i<  , - -  . 

continuous  in  aQ/o  and  p,  it  is  sufficient  tc  show  that  -l/(n-l)  and  1  are 
attainable  (at  least  in  the  limit)  .  First,  the  value  of  (3)  becomes  1  as  o^/a  —  <*>. 
Second,  from  Equation  (1)  , 


£ 


h 
n  . 


Let  p  “  -n  **  and 


o0/o 


Then,  the  value  of  (3)  is  -(n-1) 


Thus,  these  two 


models  are  equivalent. 
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CHAPTER  III 


EXTENDED  USES  OF  STANDARD  RESULTS 
WITH  FIXED  EFFECTS 

TWO-WAY  AN  OVA  WITH  NO  REPLICATION 
0.  Summary 

Consider  the  standard  two-way  cross-classification  model  for  ANOVA  with  one 
observation  for  each  combination  of  factor  levels  and  fixed  effects.  The  model 
with  no  interaction  is  used.  The  customary  assumption  of  joint  normality  is  made 
for  random  terms  when  procedures  other  than  point  estimation  are  used.  This  stan¬ 
dard  model  is  generalized,  in  several  ways,  by  addition  of  one  or  two  more  random 
terms  of  an  "error"  nature.  The  extended  models  are  much  more  generally  usable 
than  the  standard  models.  However,  except  when  all  types  of  effects  are  to  be 
investigated  simultaneously,  a  customary  procedure  for  the  standard  model  re¬ 
mains  applicable  for  one  or  more  of  its  extensions. 

1.  Introduction 

The  standard  model  for  two-way  ANOVA  with  cross-classification,  no  inter¬ 
action,  fixed  effects,  and  no  replication  is 

h*  -  * +  »j +  +  ejk.  <u 

where  j  *  1,...,J  and  k  ■  1,...,  K,  with  J,K  *  2.  Here,  y_.^  is  an  observed  random 

variable,  u  is  *  parameter,  or.  is  a  parameter  satisfying  a  +  ...  +  a  ■  0,  and 

3  l  J 

0^  is  a  parameter  satisfying  0^  +  ...  +  0R  *  0.  The  e^  are  unobserved  random 

variables  that  have  zero  mean,  the  same  variance  a2,  and  are  mutually  uncorrelated. 

The  e^k  are  also  assumed  to  have  a  joint  rail  distribution  when  significance 

2 

tests  or  confidence  regions  are  desired.  Some  or  all  of  |i,  a  ,  one  or  more  of  the 
or^,  and  one  or  more  of  the  can  be  investigated  when  model  (1)  applies. 

This  material  shews  that,  except  when  all  types  of  effects  are  investigated. 
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extensions  occur  where  the  standard  investigation  methods  remain  applicable.  Seven 


extensions  are  given.  As  always,  the  total  interest  is  in  investigating  the  effects 
for  model  (1) ,  with  no  interest  in  examining  properties  of  the  extra  random  error 
terms  added  to  this  model. 

2 .  The  Extensions 

An  extension  is  identified  by  the  one  or  two  random  terms  that  are  added  to 

the  expression  for  y^  in  the  standard  model,  and  by  the  allowable  probability 

properties  for  the  additional  random  term(s) . 

2 

First,  consider  the  case  where  a  ,  a.,  3.  are  the  types  of  effects  investigated. 

3  K 

The  extension  consists  of 


y^k  =  (standard  model)  +  e'  , 


(2) 


where,  as  for  all  the  extensions,  the  quantities  occurring  in  the  standard  model 
have  the  same  properties  as  for  that  model.  Hie  additional  random  error  e'  can 
have  an  arbitrary  distribution,  and  can  have  any  allowable  dependences  with  the 
random  error  terms  in  model  (1) . 

2 

Second,  the  types  of  effects  investigated  are  ii,  p  ,  or  and  the  extended  model 
is 


y^k  =  (standard  model)  +  e'^/  (3) 

where  the  additional  random  errors  satisfy  e'.  +  ...  +  e'  ■  0,  otherwise,  the 

JL  Iv. 

e'  can  have  an  arbitrary  joint  distribution,  and  any  permissible  dependences  with 

the  random  errors  in  the  standard  model. 

2 

Third,  ii,  a  ,  0^  are  the  types  investigated  and  the  extension  is 


y3* 


(standard  model)  +  e' ' , 

3 


where  the  additional  random  errors  satisfy  e".  +  ...  +  e"  “  0. 

X  tJ 

2 

Fourth,  the  types  investigated  are  ti,  a  and  the  extended  model  is 

y. 


'jk 


(standard  model)  +  e'  +  e''. , 

k  3' 


where  the  additional  random  errors  satisfy 


(4) 


(5) 
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0. 


J  K 

Z  Z  (e*  +  e‘ '  .)  = 

j-1  k=l  k  ^ 

Model  (5)  is  an  extension  of  models  (3)  and  (4) . 

2 

Fifth,  CT  and  a_.  are  the  types  investigated  and  the  extension  is 

=  (standard  model)  +  e'^.  (6) 

Model  (6)  is  an  extension  of  models  (2)  and  (3) . 

2 

Sixth,  a  and  are  the  types  investigated  and  the  extended  model  is 
y  =  (standard  model)  +  e1' .  (7) 

j*  3 

Model  (7)  is  an  extension  of  models  (2)  and  (4) . 

2 

Finally,  consider  the  case  where  a  is  the  type  of  effect  investigated .  The 
extension  is 

y.,  *  (standard  model)  +  e'  +  e''.  .  (8) 

3*  k  3 

Model  (8)  is  an  extension  of  all  the  otier  extended  models. 

3 .  Verification  Outline 

First,  the  standard  statistics  for  model  (1)  are  stated.  Then,  for  each 
appropriate  type  of  statistic,  or  combination  of  types,  the  extension  (or  exten¬ 
sions)  for  which  the  extra  random  errors  do  not  occur  are  identified.  For  a  given 
investigation,  the  only  usable  extensions  are  those  where  the  additional  random 
errors  are  eliminated  in  all  the  statistics  for  the  investigation.  Then,  the 
probability  properties  for  the  statistics  are  the  same  as  for  model  (1) ,  so  that 
the  customary  results  apply  (for  example,  see  Graybill  (1961)) . 

The  statistics  considered  are 

A  A  A 

v>  ~  y..»  <*j  “  yj.  -  y..»  ek  =  y.k  -  y..» 

2  J  2  2  K 
s  “  Z  (y  -  y  )  ,  s  *  Z  (y  -  y  )  , 
a  j-1  3-  ••  *  k-1 
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2 


s 

e 


J 

E 


K 

E  (y 

k=l 


j* 


y.k+  y 


2 


2  2  2 

Here,  is  used  to  investigate  a  .  Also,  sg  is  used  in  investigations  for  the 

other  types  of  effects  (tests,  confidence  regions,  estimates  of  variances  of 

2 

estimates) .  The  statistic  s  is  free  of  the  additional  random  terms  for  all  of 

e 

the  extensions. 

“2  2 

The  statistics  a.  and  s  are  used  to  investigate  the  a,.  Both  s  arxi  ti.° 

3  a  3  a 

at.  are  free  of  the  additional  random  terms  for  models  (2)  ,  (3)  ,  and  (6)  . 

2  2 

The  statistics  0  and  s  are  used  to  investigate  the  0  .  Both  s  and  the 

a  D  K  D 

0^  are  free  of  the  additional  random  variables  for  models  (2) ,  (4) ,  and  (7) . 

A 

Finally,  the  statistic  p,  is  used  to  investigate  p,  and  is  an  unbiased  estimate 

A 

of  u-  The  statistic  p,  is  free  of  the  additional  random  variables  for  models  (3)  , 

!4)  ,  and  (5)  . 

TWO-WAY  ANOVA  WITH  INTERACTIONS 
0 .  Summary 

Considered  is  the  standard  two-way  cross-classification  model,  with  fixed 
effects  and  including  interactions.  This  standard  model  is  extended  by  addition 
of  one  or  two  more  "error"  terms.  However,  except  when  all  the  types  of  effects 
are  to  be  considered  simultaneously,  the  customary  procedures  for  the  standard 
model  remain  applicable  for  at  least  one  of  the  extended  models.  Also,  a  proce¬ 
dure  for  rejection  of  outliers  using  the  standard  model  is  outlined,  and  shown  to 
be  applicable  for  the  most  general  extension. 

1.  Introduction 

The  balanced  model  for  two-way  ANOVA,  with  cross-classification,  interactions, 
and  fixed  effects  is 


y 


ijk 


U  +  or.  +  0  .  +  Y.  •  +  e. 

i  3  ' 13  13* 


(1) 
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where  i  *  1, . . . ,  I;  j  -  k  =  1,... ,K;  with  I ,  J ,  K  2  2 .  Here ,  y .  is 

i  jk 


an  observed  random  variable,  n  is  a  parameter,  a ^  is  a  parameter  satisfying 


0r1  +  ...  +  a  3  0,  and  is  a  parameter  satisfying  0..  +  ...  B  =  0.  The  v 


1  '  “I  - - -j - * - - - -  K1  "J 

are  parameters  that  satisfy  y.,  +  ...  +  y.  -  0  for  all  i,  and  y_  + 

ll  'u  'll 


for  all  j.  The  e. are  unobserved  random  variables  and  are  mutually  uncorreiacec 
ilk 


with  zero  mean  and  variance  a  .  The  e. are  also  assumed  to  have  a  joint  normal 

ilk 


distribution  when  something  besides  point  estimation  is  desired. 

First,  consider  a  description  of  a  method  for  deciding  whether  an  observation 

is  an  outlier.  Let  y.  ^  be  selected,  without  knowledge  of  the  observation  values, 

ilk* 


for  investigation  as  a  possible  outlier.  Divide  the  observations  with  this  i,  j 
value  into  sets  of  size  two,  and  one  or  zero  sets  of  size  three  (unbiasedlyi  so 


that  y.  _  is  not  in  a  set  of  size  three.  When  a  set  of  size  three  occurs,  it  is 
ilk* 


modified  to  a  set  of  size  two  by  (unbiasedly)  combining  two  of  its  observations. 
Specifically,  two  of  the  observations  are  added  and  their  sum  divided  by  /2 ,  to 
yield  one  "observation."  This  "observation"  is  identified  by  using  the  larger  of 
the  two  values  for  k  in  the  observations  summed.  For  each  of  the  resulting  sets, 
a  statistic  of  the  kind 


yi jk (1)  '  yijk (2)  ei jk  ( 1)  "  ®ijk(2) 


is  formed,  where  k(l)  *  k*  for  the  set  containing  y^j^**  These  statistics  are 


un¬ 


correlated  with  the  same  variance  and  zero  mean.  The  statistic  containing  y.  ^ 

ilk* 


can  be  investigated  as  an  outlier,  when  the  assumption  of  normality  for  the  e. 


ijk 


is  also  made.  This  can  be  done  by  use  of  a  procedure  for  deciding  whether  a 
specified  observation,  believed  to  be  in  a  sample  from  a  normal  population  with 
zero  mean  (  and  selected  without  knowledge  of  the  sample  values) ,  is  an  outlier. 
Fifteen  extensions  of  model  (1)  are  given.  An  extension  is  made  by  addition 


of  one,  or  two,  more  "error"  terms  (of  different  kinds)  to  the  standard  model 


2 .  Extensions 
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I  J 

I  Z  <e'.  +  e!‘)  -  0. 
i-1  j-1  3  1 

Model  (7)  is  an  extension  of  models  (3)  and  (4) . 

2 

Seventh,  a  ,  Y^  are  the  types  investigated  and  the  extended  model  is 

yijk  "  *  +  «i  +  Pj  +  yij  +  eijk  +  ej  +  ei'  ‘  (8) 

Model  (8)  is  an  extension  of  models  (5) ,  (6) ,  and  (7) . 

2 

Eighth,  the  types  of  effects  investigated  are  g,,  a  ,  cr,  B..  and  the  extension 


y .  ..  =  )A  +  a-  +  P  •  +  Y-  •  +  e.  ..  +  e*  . , 

13k  ^  1  3  13  13k  13 

where  the  additional  random  variables  satisfy  (i  =  j-l,...,J) 


Z  e*  .  =  0. 

j-1  13 


Ninth,  g,  a  ,  cr  are  the  types  investigated  and  the  extended  model  is 

y.  *  H  +  a.  +  P .  +  Y.  .  +  e .  ..  +  e*  . ,  (3 

jrX3k  ^  “1  Ti3  ijk  i  j '  v 

where  the  additional  random  variables  satisfy 


le*.  *  0, 


(i=1 


Model  (10)  is  an  extension  of  model  (9) . 

2 

Tenth,  the  types  investigated  are  n,  a  ,  B^  and  the  extension  is 

y.  .  -  u  +  or.  t8.  +  Y-.+e...+e*., 

13k  **  1  k3  13  13*  13 

where  the  additional  random  variables  satisfy 


Ie‘,  -  0, 
i-1  13 


(j-l,...,J)  . 


Model  (11)  is  an  extension  of  model  (9) . 


Eleventh,  of^ ,  B ^ »  a  are  the  types  investigated  and  the  extended  model  is 
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where  the  additional  random  variables  satisfy  (i  “  1, . . . ,1?  j“l,...,j) 


le*..  «C.(  E  cr.  *  c  , 

i-1  13  1  j-1  ^  2 

with  c1#  C2  constants  that  can  have  any  values.  Model  (12)  is  an  extension  of 
models  (2)  and  (9)  . 

2 

Twelfth,  the  types  investigated  are  a  ,  a i  and  the  extension  is 

+  +  +  +  ,13) 

where  the  additional  random  variables  satisfy 


E  e*  =  C, 
j-1  3 


(i  —  1,...,I) , 


with  C  a  constant  that  can  have  any  value.  Model  (13)  is  an  extension  of  models 

(5)  ,  (10)  ,  and  (12)  . 

2 

Thirteenth,  a  ,  B_.  are  the  types  investigated  and  the  extension  is 

y.  =  u  +  a.+B.+v..+e...  +  e*  . ,  (14) 

■rxjk  p  l  *3  Ti]  13k  ij'  1  1 

where  the  additional  random  variables  satisfy 


E  e*  .  =  C, 
i-1  13 


(j"”l,...,vj)  • 


Model  (14)  is  an  extension  of  models  (6  ) ,  (11) ,  and  (12)  . 

2 

Fourteenth,  the  types  investigated  are  u,  cr  and  the  extended  model  is 

y...  -M.  +  0,  +B.+V.  .+e..,  +  e*  . ,  (IE 

13k  i  j  'ij  13k  13' 

where  the  additional  random  variables  satisfy 

I  J 

E  E  e* .  -  0 . 
i=l  j-1  13 

Model  (15)  is  an  extension  of  models  (7) ,  (10) ,  and  (11) . 

2 

Finally,  a  is  investigated  and  the  extended  model  is 


y .  ..  =  u  +  Qf.  +  B .  +  y.  .  +  e.  ..  +  e*  . . 
13k  1  3  13  13 
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t 


Model  (16)  is  an  extension  of  all  the  other  extensions  and,  as  is  easily  verified 
the  method  outlined  for  rejection  of  outliers  (using  the  standard  model)  remains 
applicable  for  model  (16) . 


3.  Outline  of  Verifications 

The  statistics  customarily  used  for  model  (1)  are  stated  and  the  extended 
models  for  which  the  additional  random  variables  do  not  occur  are  identified.  Also, 
identification  is  given  for  the  type(s)  of  effects  investigated  by  a  stated 
statistic . 

Some  further  notation  is  introduced  for  stating  the  statistics  considered. 

This  is 

A  A  A 

n  “  y  »  of,  *  y,  -  y  »  e.  =  y  -  y  . 

•  ••  A  A  •  •  •••  J  •  J  •  ••• 


Yii  “  -  v±  -  y  i  +  y  *  4  =  r  (yi  -  y  )  2 

L  J  x  j  •  x  •  •  •  J  •  •••  x  •  .  •  •  • 


I  (y  .  -  y  )  , 

j-i  °* 


2  1  J  2 

s  *  E  E  (y  -  y  -  y  .  +  y  )  , 

G  i=l  j=l  13  *  1*  *  *3 * 


I  J  K 

Z  E  E  (y  -  y  )\ 

E  i-1  j-1  k=l  13*  3* 

2  2 

The  statistic  S£  is  used  to  investigate  O  and  is  free  of  the  additional  random 

2 

variables  for  all  the  extended  models.  Also,  S  is  used  for  investigations  of  the 

£ 

other  types  of  effects  (and  occurs  in  significance  tests,  confidence  regions, 
estimates  of  variances  of  estimates,  etc.) . 

A  2 

The  statistics  5.  and  S.  are  used  to  investigate  the  a.  and  are  free  of  the 
1  A  x 

additional  random  terms  for  models  (2)  ,  (3)  ,  (5)  ,  (9)  ,  (10)  ,  (12)  ,  and  (13)  .  The 

A  A 

statistics  8.  and  S„  are  used  to  investigate  the  8.  and  additional  random  variables 
do  not  occur  in  these  statistics  for  models  (2)  ,  (4)  ,  (6)  ,  (9)  ,  (11)  ,  (12)  ,  and 
(14)  . 


J 
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The  statistics  y  and  are  used  for  investigating  the  y  and  are  free  of 

A 

additional  random  variables  for  models  (2)  -  (8)  .  The  statistic  p,  is  used  to 
investigate  n  and  is  free  of  the  additional  random  terms  for  models  (3) ,  (4) ,  (7) , 


(9)  ,  (10)  ,  (11)  ,  and  (15)  . 


CHAPTER  IV 


EXTENDED  USES  OF  STANDARD  RESULTS 
WITH  RANDOM  EFFECTS 


TWO-WAY  ANOVA  WITH  NO  REPLICATION 
0 .  Summary 

Considered  is  the  standard  two-way  classification  model  for  ANOVA  with  random 
effects  and  no  replication.  No  interactions  occur.  TYiis  s_ar>dard  model  is  gener¬ 
alized  by  addition  of  one  or  two  more  random  terms  of  an  “error"  nature.  However, 
except  when  all  types  of  effects  are  to  be  investigated  simultaneously ,  a  custom¬ 
ary  procedure  for  the  standard  model  remains  applicable  for  one  or  more  extensions. 
1.  Introduction 

The  standard  model  for  two-way  analysis  of  variance  with  cross-classification, 
random  effects  (variance  components  model) ,  and  no  replication  is 

yi*  '  “ +  +  *>*  +  V  a> 


where  j  =  1,...,J  and  k  *  1,...,K,  with  J,K  2  2.  Here,  y  is  an  observed  random 

*  3k 

variable,  (i  is  a  parameter,  the  a^  are  unobserved  random  variables  with  zero  mean 
2 

and  variance  a  ,  the  b,  are  unobserved  random  variables  with  zero  mean  and  vari- 
a  k 

2  2 
ance  a.  ,  the  e.,  are  unobserved  random  variables  with  zero  mean  and  variance  a  , 
b  3k  e 

and  the  a.,  b  ,  c..  are  nutually  uncorrelated.  When  tests  or  confidence  regions 
3  k  3k 

are  desired,  the  a.,  b,  ,  c._  are  also  assumed  to  have  a  joint  normal  distribution. 

3  k'  3k 

2  2  2 

The  types  of  effects  receiving  consideration  are  17  ,  CT,  ,  and  cr  .  Except 

a  b  c 

when  all  these  effects  are  to  be  investigated  simultaneously,  extensions  are  given 
for  which  the  standard  investigation  methods  are  still  usable.  Seven  extended 
models  are  stated. 


2.  The  Extended  Models 


An  extended  model  is  identified  by  the  one  or  two  random  terms  that  are  added 


to  the  expression  for  y  in  the  standard  model,  and  by  the  allowable  probability 

1* 
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properties  for  the  additional  random  error (s) . 

2  2  2 

First,  consider  the  case  where  a  ,  a  ,  a  are  the  types  of  effects  inves- 

C  3  D 


tigated.  the  extended  model  consists  of 


y  *  {standard  model)  +  e', 
1* 


(2) 


where,  as  for  all  the  extensions,  the  quantities  that  occurred  in  the  standard 
model  have  the  same  properties  as  for  that  model. 

2  2 

Second,  the  types  of  effects  investigated  are  u,  a  ,  a  and  the  extended 

c  a 

model  is 


y  =  (standard  model)  +  e*  , 

3  K  K 


(3) 


where  the  additional  random  variables  satisfy  e’  +  ...  +  e'  =0. 

X  1C 

2  2 

'rtiird,  \i,  a  ,  a,  are  the  types  investigated  and  the  extension  is 
c  b 


y  =  (standard  model)  +  e’1. , 

3K  j 

where  the  additional  random  variables  satisfy  e' '  +  ...  +  e1'  =  0. 

1  3 


(4) 


Fourth,  the  types  investigated  are  (i  and  a  and  the  extended  model  is 

c 


y  =  (standard  model)  +  e'  +  e’’. , 
JK  K  3 


where  the  additional  random  variables  satisfy 


(5) 


Z  I  (e*  +  e"  .)  =0. 

j=l  k=l  3 

Model  (5)  is  an  extension  of  models  (3)  and  (4) . 

2  2 

Fifth,  ac  and  ca  are  investigated  and  the  extension  is 

y  =  (standard  model)  +  e'  . 

1C 

Model  (6)  is  an  extension  of  models  (2)  and  (3) . 

2  2 

Sixth,  oc  and  are  investigated  and  the  extended  model  is 


(6) 


rjk 


(standard  model)  +  e''.  . 

3 


Model  (7)  is  an  extension  of  models  (2)  and  (4) . 


(7) 


Seventh,  consider  the  case  where  CTc  is  the  effect  investigated.  The  exten¬ 


sion  is 
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(8) 


y  ,  ■  (standard  nocel)  +  e*  +  e". . 

3*  *3 

Model  (8)  is  an  extension  of  all  the  other  extensions. 

3.  Outline  of  Justification 

The  standard  statistics  used  with  model  (1)  are  defined  first.  Then,  these 
statistics  are  associated  with  the  extended  models  to  which  they  are  applicable. 
The  statistics  are 


u  -  y 


2  -  r  ,  s2 

s,  ~  E  (y .  -y  )  . 

a  j*l 


E  :y  v-y  )  , 
k-l  *  “ 


2  J  K  2 

s  =  I  E  (y,k  -  y.  -  y  k  +  y  )  . 

c  j*=l  k*l  3  *  *K 

2  2 

Here,  s  is  used  for  investigating  a  ,  and  is  used  in  the  investigations  for 
c  c 

2 

other  types  of  effects.  The  statistic  s  is  free  of  the  additional  random  terms 

c 

for  all  the  extensions. 

2  2 

The  statistic  s  is  used  to  investigate  a  ,  and  is  free  of  the  additional 
a  a 

random  error  terms  for  extended  models  (2) ,  (3) ,  and  (6) . 

2  2 

The  statistic  is  used  to  investigate  afa  ,  and  is  free  of  the  extra  random 
error  terms  for  extended  models  (2) ,  (4) ,  and  (7) . 

A 

Finally,  p  is  used  to  investigate  p,  and  is  an  unbiased  estimate  of  p.  The 

A 

statistic  p  is  free  of  the  additional  random  variables  for  extended  models  (3) , 

(4)  ,  and  (5)  . 

VARIANCE  COMPONENTS  MODELS-GENERAL 


0.  Suzmnary 


Considered  are  standard  N-way  (N  2  1)  variance  components  (random  effects) 


models  for  ANOVA.  These  are  examined  in  a  somewhat  general  sense,  with  interest 


in  verifying  that  many  of  the  customary  investigation  methods  also  apply  for  exten¬ 
sions  of  these  models.  An  extension  is  obtained  by  adding  a  further  random  error 


term  to  the  standard  model,  where  the  error  term  sometimes  is  different  for  various 
cases  of  the  model.  IVo  specific  illustrations  are  given.  Also,  some  ways  of  in¬ 
vestigating  outliers  for  nested  designs,  which  also  apply  to  the  extensions,  are 
discussed . 

1.  Introduction 

The  statistical  results  that  occur  for  the  usual  variance  components  models 
can  also  be  obtained  for  generalizations  of  these  models  that  use  substantially 
less  restrictive  assumptions. 


To  illustrate  the  generalization  approach,  consider  the  usual  model  for  a 
balanced  one-way  classification.  An  observation  is  denoted  by  y„,  where  i  =  1, 
...,  I  and  j  *  1,  ...»  J.  The  model  assumes  that 


Yij  =  *  +  ai  +  bij'  (1) 

where  n  is  a  parameter,  each  a^  is  a  random  variable  with  zero  mean  and  variance 

2  2 
a  ,  and  each  b. .  is  a  random  variable  with  zero  mean  and  variance  a.  . 
a  i]  b 

2 

The  statistics  used  for  investigating  a  are 

Cl 

1  J  2  1  2 

E  I  (y,^  -  y,  )  and  E  (y.  -  y  )  (2) 

i«i  j«i  13  i-i 

(for  example,  see  Graybill  (19611  . 

The  extension  of  model  (1)  permits  the  presence  of  an  additional  random  vari¬ 


able  e 1  and  assumes  that 


r .  .  “u+a.  +b  +  e". 
il  l  ij 


The  aA  and  the  b^  have  the  same  properties  as  for  model  (1)  .  Model  (3)  allows 

2  2  2 

both  a  and  a.  to  be  investigated.  When  only  o.  is  considered,  a  much  more 

a  D  D 


general  model  can  be  used  in  which  e,  is  the  additional  random  error  in  the  model 
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for  (i  ■  1,  ...»  I)  . 

It  is  to  be  noted  that,  for  the  normality  case  of  this  nested  design,  models 

2 

(1)  ,  (3)  and  that  for  investigating  ofa  allow  investigation  of  whether  the  value 
of  a  specified  is  an  outlier.  With  I  even,  given  i,  and  given  j  *  j  (1)  ,  an 

investigation  is  based  on 

yij(l)  “  yij  (2)  '  yi j  (3)  ‘  yij(4)'  **•'  yij<I-l)  "  yij  (I)  , 
where  j (1) , . . . , j (I)  are  the  different  values  for  j.  These  differences  are  indepen¬ 
dent  and  equal 

bij(l)  "  bij(2)'  ***'  bij  (1-1)  "  bij  (I) 

respectively,  so  they  have  the  same  normal  distribution  with  zero  mean  when  the 

2 

model  for  investigating  o.  holds.  Whether  b.  .  is  an  outlier  (and  the  other  of 

b  x]  (1) 

these  b's  satisfy  the  conditions  of  the  model)  can  be  investigated  by  methods  for 
deciding  whether  a  given  observation,  supposedly  in  a  random  sample  from  a  normal 
population  with  known  mean,  is  to  be  considered  an  outlier.  This  approach  is 
usable  in  any  nested  design  for  investigating  the  random  variables  that  have  all 
the  subscripts  used  in  the  model.  The  additional  variables  for  the  extended  model 
can  have  all  the  subscripts  that  occur  for  the  other  random  variables  of  the  nested 
model  being  extended . 

The  level  of  generalization  that  can  be  attained  by  the  presence  of  one  or 
more  additional  random  variables  is  related  to  what  is  investigated  and  to  the 
number  of  variance  components  investigated  (decreases  as  the  number  of  variance 
components  increases)  .  For  example,  consider  the  usual  model  for  a  balanced  three- 
way  cross  classification,  where  i  ■  1,  I;  j  *  1,  ....  j;  and  k  *  1,  ...,  K. 

This  model  is 


y.  ..  ■  u  +  a.  +  b.  +  c.  +  d .  ,  +  f..  +  g..  +  h.  , 
i]k  ^  i  j  k  13  ik  ^3k  13k' 


with  i*  a  parameter  and  the  other  quantities  random  variables.  All  the  random 
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variables  have  zero  expectation,  the  a.  have  variance  a  ,  the  b.  a  variance  of 

i  a  3 

2  2 

o.  the  h.  ..  variance  a.  .  Also,  the  random  variables  are  mutually  indepen- 

b  i3K  n 

dent. 

2  2 

When  all  of  a.  a  are  investigated,  a  single  random  variable  e'  occurs 

b  g 

2  2  2 

in  the  extension  model.  When  a  ,  a.  ,  and  a,  are  investigated,  the  extension 

a  b  d 


model  is 


yijk  “  »  +  ai  +  bj  +  ck  +  dij  +  fik  +  gjk  +  hijk  +  V 

so  that  K  additional  random  variables  are  present.  The  increase  in  generality 

level  with  K  additional  random  variables  is  much  greater  than  that  for  one  addi- 

2 

tional  variable,  even  if  K  =  2.  When  only  a  is  investigated,  JK  additional 

d 

random  variables  e  can  be  present,  with  an  appreciable  increase  in  generality 
3* 

level  as  compared  with  one  additional  random  variable  or  K  additional  variables. 

2  2  2 

Similar  remarks  apply  to  investigation  of  r  <Tc  ,  <r  ,  to  investigation  of 
2 

CT  ,  etc. 
c 

General  results  for  N-way  classifications  with  variance  components  models  are 
stated  in  the  next  section. 

2.  General  Extended  Models 

To  cover  the  very  general  class  of  situations  considered,  a  notation  similar 
to  that  of  Walsh  (1968) ,  for  fixed  effects  models,  is  used.  Explicit  investigation 
procedures  may  not  have  been  developed  yet  for  some  special  cases  of  the  general 
class  of  “usual"  models  that  is  considered.  However,  the  purpose  of  this  paper  is 
limited  to  showing  how  such  models  can  be  extended . 

Virtually  all  of  the  usual  models  for  an  N-way  classification  in  variance 


components  express  an  observation  y[i(l) ,...,i(N)J  in  the  form 


r 


where  the  £  denotes  summation  over  the  values  of  j^,...,j  such  that 
is  jj  <  ...  <  j  <  M,  perhaps  subject  to  restrictions  on  the  joint  values  of 
j.M.wj,.  Also,  1  ^  i(l)  £  J.;...;  1  £  i(N)  ^  j  perhaps  subject  to  restric- 
tions  on  the  joint  values  of  id)  , . . . ,  i  (N)  .  Here  li  is  constant,  all  of  the 

A[i ( j^) , . . . ,i ( j  ) ]  are  random  variables  with  zero  expectation,  and,  for  fixed 

2 

j1»****jtf  the  Ali(j  ) , . .  .,i(j  ) ]  have  the  same  variance  c (j^, ... ,jfc)  .  The  only 
2 

<r  ( j  ^ , . . . ,  jfc)  investigated  are  those  for  which  t  ^  n  -1. 

Sometimes  the  allowable  combinations  of  j^,...»jt  for  t  s  N  -  1  do  not  include 
all  of  1,...,N  (such  as  for  nested  classifications).  Then,  a  model  for 
y[i(l) , . . . ,i(N) ]  may  not  be  called  on  N-way  design,  although  it  would  be  a  special 
case  of  model  (4) . 

2 

The  statistics  used  to  investigate  CT(j^,...,j  )  for  given  j^,...,jt  nearly 

2 

always  are  also  used  to  investigate  all  of  the  otHfj^ . . .  ,3^)  ]  ,  where  H(j1,...,jfc) 
denotes  any  subset  of  j  , . . . , j^;  the  variance  for  the  random  variables  involving 
this  subset  of  j^r...,j  is  represented  by  ct[h ( j f j  ) ]  .  Only  models  (4) 
where  this  is  the  case  are  considered. 

2 

The  statistics  virtually  always  used  for  investigating  C(j^,...,j  )  and  the 
2 

<j[h(  j^, . . . ,  jfc)  ]  are  sums  of  square  for  differences  of  observations.  These  sums 
of  squares  virtually  always  have  the  property  that  A's  not  involving  any  of 
j,...,j^  cancel  out  in  all  of  these  sums  of  squares.  In  fact,  one  or  more  nui¬ 
sance  parameters  would  be  introduced  if  not  all  of  these  A's  cancelled  out  in  the 
sums  of  squares.  Only  models  (4)  where  the  A's  have  this  property  for  the  statis¬ 
tics  used  are  considered. 

Now,  consider  the  extended  form  of  model  (4)  when  model  (4)  satisfies  the 

conditions  of  the  preceding  two  paragraphs.  The  most  elementary  case  is  that 

2 

where  the  variance  components  investigated  are  q(k^t...(k  )  and  the 
2 

cfHOc^, . . .  ,ky) ]  ,  for  given  values  of  k^,...,k  ,  (1  s  u  ^  N  -  1) .  In  this  extended 


29 


model,  y [ i (1) ,  . . . , i (N) ]  is  expressed  as 


H  + 


+  e[i(k')  ,  —  ,i (k '  )], 

t  i  n-u 


where  k^,...,k^  consists  of  the  values  of  1,...,N  that  are  not  equal  to  any 

of  k^,...,ku.  The  A[i ( j^) , . . .  ,i  ( j  ) ]  have  the  same  properties  as  for  model  (4), 

including  the  conditions  imposed.  The  joint  distribution  of  the 

e[i(k^), _ ,i(k^  '  is  arbitrary.  Also,  any  permissible  dependence  between  the 

e[i  (k  * )  , . . .  ,i  (k'  )]  and  the  A[i(j,), _ ,i(j  )]  can  occur.  The  first  or  second 

1  N-U  1  Z 

moments  do  not  necessarily  exist  fcr  the  e's,  and  the  covariances  of  the  e's  and 
the  A's  do  not  necessarily  exist.  An  e[  ]  can  have  a  different  dependence  with 
each  of  the  A's.  However,  when  the  covariance  matrix  for  the  y [ i ( 1) , . . . , i (N) ] 
exists,  it  is  positive  definite. 

Although  the  e [ i (k^),. . . , i (k^  ^) ]  occur  in  the  extended  model,  they  cancel  out 

2  2 

in  the  statistics  used  for  investigating  o(k^,...,k  )  and  the  c[h (k^, . . . ,k^) J  . 

Thus,  an  investigation  based  on  model  (4)  remains  applicable  when  this  extension 

of  model  (4)  represents  the  observations. 

The  general  case  is  where  the  a(k,  . . .  ,k^\  )  2  and  the  ct[h  (k  , . . .  ,k  ( ^  '  ] 

1  u(r)  1  u(r) 

are  investigated  for  r  =  1,...,R.  Here,  u(r)  ^  N  -  1  for  all  r.  In  this  general 

extended  model,  y(i (1)  , . . .  ,i  (N) ]  is  expressed  as 


N 

u  +  £ 


t—  l  j^,...,j^ 


A[ i  ( j) , . . . , i ( j  ) ]  +  e[ i (s  ) , . . . ,i (s  )], 

t  «*■  n 


where  s^,...,Sp  consists  of  the  values  of  1,...,N  (if  any)  that  are  not  equal  to 
any  of  the  k^  , . . .  for  r  =  1,  . . . ,  R. 

As  for  the  elementary  case,  the  ef i(s^) , . . . ,i (s  ) ]  cancel  out  in  the  statis¬ 
tics  used  for  the  investigation.  Also,  the  consnents  abcut  the  e[  ]  for  the 
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CHAPTER  V 


EXTENSIONS  OF  MODELS  HAVING  FIXED  EFFECTS, 
WITH  INVESTIGATION  OF  ALL  EFFECTS 


ONE-WAY  ANOVA  MODEL 
0 .  Summary 

Consider  the  standard  one-way  ANOVA  model  with  fixed  effects.  Extensions 
are  made  of  this  one-way  model  by  addition  of  further  "error"  terms  of  one  or 
two  kinds.  For  the  extensions,  exact  procedures  are  obtained  for  investigating 
all  the  effects  that  appear  in  the  standard  model,  and  for  investigating  subsets 
of  these  effects.  For  several  extensions,  the  customary  results  for  the  standard 
model  remain  applicable  (and  are  of  the  nature  of  the  material  in  Chapter  III) . 

Some  procedures  differing  from  the  customary  ones  are  used  for  the  other  extensions. 
1.  Introduction 

The  balanced  fixed  effects  model  for  one-way  analysis  of  variance  is 


'jk 


2  n  e 

1  Ik' 


(1) 


where  j  -  1,...,J  and  k  -  1,...,K,  with  J,K  2  2.  Here,  y.  is  an  observed  random 

Dk 


variable,  ^  is  a  parameter,  a.  is  a  parameter  such  that  a.  +  . ..  +  y  =  0,  and  e 

3  j-  J  gk 


is  an  unobserved  random  variable.  The  e . ,  are  assumed  to  be  uncorrelated  with  zero 

Ik 


expectation  and  the  same  positive  variance  a  .  They  are  also  assumed  to  have  a 
goint  normal  distribution  when  something  other  than  a  point  estimate  is  desired. 

Seven  extensions  of  the  standard  model  (1)  are  given.  An  extension  is  made  by 


adding  more  "error"  terms,  of  one  or  two  kinds,  to  the  standard  model  for  y^.  An 


extension  occurs  such  that  p,,  a  ,  and  one  or  more  of  the  a  can  all  be  investigated 
by  exact  procedures.  Some  of  the  statistics  for  these  investigations  differ  from 
those  customarily  used  for  model  (1) . 

2.  Extended  Models 
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The  extensions  given  depend  on  which  effects  are  to  oe  simultaneously  investi¬ 


gated  and  on  whether  the  statistical  procedures  are  restricted  to  those  customarily 

used  for  model  (1) .  The  results  using  standard  procedures  are  given  here,  rather 

than  in  Chapter  III,  for  presentation  convenience. 

2 

First,  consider  the  extended  model  when  p,,  a  ,  and  one  or  more  of  the  or  are 
all  to  be  investigated.  Limitation  to  the  results  customarily  used  does  not  apply 
tr  this  case.  The  model  is 


3* 


u  +  o.  +  e.,  +  e',  , 
K  3  gk  k' 


(2) 


where  a  ,  and  e..  have  the  same  properties  as  for  model  (1) .  The  additional 
3  3* 

random  errors  e',...,e*  must  sum  to  zero. 

1  K 

Second,  consider  the  case  where  the  eligible  procedures  are  not  restricted  and 
2 

investigation  of  a  and  one  or  more  of  the  cr  is  to  occur.  The  extended  model  for 
this  ca.e  is 


yjk-„  +  a.  +  ejk  +  ej.  (3) 

Model  (3)  is  an  extension  of  model  (2) . 

Third,  consider  the  case  where  the  procedures  are  restricted  to  these  custom- 

2 

arily  used  for  model  (1)  and  investigation  of  a  and  one  or  more  of  the  or  is  to 

occur.  The  extension  for  this  case  is 

y..  “H+Of.  +  e  +e*.  (4) 

3k  3  3^ 

This  is  the  least  general  of  the  extensions  considered  and,  for  K  >  2,  is  much  less 
general  than  model  (2)  . 

Fourth,  consider  the  case  where  the  eligible  procedures  are  not  limited  and 
2 

both  vi  and  o  are  investigated.  The  extended  model  is 

1'jk'‘*  +  a3  +  '3k  +  eit,i''  l5’ 

where  e'  +  . . .  +  e ’  *  0  and  e' '  +  ...  +  e'1  ■  0.  Model  (5)  is  an  extension  of 
1  K  X  J 

models  (2)  and  (4)  . 
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Fifth,  consider  the  case  where  the  procedures  are  restricted  to  the  customary 

2 

ones  for  model  (1)  and  investigation  of  both  ia  and  a  occurs.  The  extension  is 

yjk  =  U  +  «j  +  ejk+  e”,  (6) 

where  e! '  +  ...  +  e''  =  0.  Model  (5)  is  also  an  extension  of  this  model. 

X 

2 

Only  a  is  investigated  for  the  final  two  extensions.  When  the  eligible 
procedures  are  not  restricted,  the  extension  is 

yjk  =  *  + v  ejk  +  e£  +  er*  (7) 

This  is  the  most  general  model  considered  and  is  an  extension  of  model  (5) . 

Finally,  suppose  that  the  procedures  are  limited  to  those  customarily  used 
2 

and  a  is  investigated.  The  extended  model  is 

“  +  +  +  6"  '  <8> 

Model  (8)  has  substantially  less  generality  than  model  (7)  but  is  the  most  general 

extension  given  that  is  usable  with  an  application  of  the  method  for  rejection  of 

outliers  that  is  described  in  earlier  material. 

As  is  easily  seen,  the  generality  of  a  model  is  strongly  reduced  when  the 

eligible  procedures  are  limited  to  those  customarily  used  for  model  (1) .  Actually, 

the  only  statistic  encountered  that  is  not  standard  is  the  statistic  for  investi- 
2 

gating  CT  (also  used  m  tests  and  confidence  regions  for  the  other  effects)  . 

3.  Basis  for  Investigations 

This  section  states  the  statistics  considered  for  use  along  with  the  effects 

they  investigate,  the  extended  model (s)  for  which  the  additional  terms  do  not 

occur,  and  pertinent  properties.  For  a  given  investigation,  at  least  one  statistic 

2 

is  introduced  for  each  type  of  effect  (|A,  a  ,  one  or  more  of  the  cr^)  that  is  to  be 

2 

investigated.  A  statistic  for  investigating  a  is  always  included,  since  this 
statistic  occurs  in  the  tests  and  confidence  intervals  for  any  type  of  effect,  and 


3 


also  occurs  in  estimates  of  variances  for  point  estimates  of  effects. 


Some  of  the  more  elementary  probability  properties  of  the  statistics  are 
stated  without  verification.  However,  proofs  are  easily  obtained  from  considera¬ 
tions  such  as  those  given  in  Graybill  (1961) .  Also,  the  customary  results  are 
obtained  from  material  in  Graybill  (1961) . 

Some  further  notation  is  introduced  for  stating  the  statistics  that  are  con¬ 
sidered  for  possible  use. 

A  A 

V-  =  y  /  a  =  y  -  y  , 

.  .  j  j  . 

2  ^  *  2  2^^  2 

s  =  E  or .  /  (J-l)  ,  s  =  E  E  (y ..  -  y.  )  /J(K-l)  , 

a  j=l  3  j=l  k=l  JK  D‘ 


2  J  K 

s„  =  E  E  (y.v  -  y .  -  y  k  +  y  )  /(J-l)  <*-i)  . 

j — 1  k=  1  ^ ^  J 


ii 


2  2 

F  _  =  Ks  /S 
al  a  I 


2  2 

F  tt  =  Ks,  /Stt  • 
all  a  II 


2  2 
The  statistic  s^  is  the  customary  unbiased  estimate  of  o  for  model  (1)  and  is 


free  of  the  additional  random  terms  for  extended  models  (4) ,  (6) ,  and  (8) .  The 


2  2 

statistic  s^j  is  an  unbiased  estimate  of  a  and  is  free  of  the  additional  random 


terms  for  all  the  extended  models.  With  models  (4) ,  (6) ,  (8)  and  normality. 


2  2  2 

J (K-l) Sj  /a  has  a  x  -distribution  with  J (K-l)  degrees  of  freedom.  For  all  the 


2  2  2 

models  and  normality,  (J-l)  (K-l)  /a  has  a  x  -distribution  with  (J-l)  (K-l) 


degrees  of  freedom. 


2  . 


The  statistic  s  is  free  of  the  additional  random  terms  for  models  (2) ,  (3) 


and  (4) .  When  the  normality  assumption  also  holds  for  the  e  ,  and  any  of  models 


(2) ,  (3) ,  or  (4i  applies,  the  statistic  F  has  an  F-distribution  with  J-l  and 


(J-l) (K-l)  degrees  of  freedom  under  the  null  hypothesis  that  the  are  all  zero 


This  is  readily  verified  by  shewing  that  the  y.  -  y  are  uncorrelated  with  the 


2  2  2 

y  -y.  -  y  .  +  y  and  that,  under  the  null  hypothesis,  K(J-l)s  /a  has  a  x  - 

jk  3*  *k 


2  2  2 

distribution  with  J-l  degrees  of  freedom  and  (J-l) (K-l) s  /a  has  a  x  -distribu¬ 
tion  with  (J-l) (K-l)  degrees  of  freedom.  For  normality,  the  all  zero,  and  model 

(4) ,  the  statistic  F  has  an  F-distribution  with  J-l  and  J (K-l)  degrees  of  freedom 
a  -L 

(the  customary  result  when  model  (1)  applies)  . 

A 

The  statistic  a.  is  the  customary  unbiased  estimate  of  or.  for  model  (1)  and  is 
3  3 

free  of  the  additional  random  terms  for  models  (2) ,  (3) ,  and  (4) .  For  these  ex- 

2 

tended  models,  (J-l)  s^  /JK  is  an  unbiased  estimate  of  the  variance  of  or_.  and, 

when  the  normality  assumption  also  holds  for  the  e_.^»  is  independent  of  (since 

the  y.  -  y  are  uncorrelated  with  the  y  -  y.  -  y  +  y  ).  The  statistic 

j.  jk  j  .  .K.. 

2  “ 

(J-l) Sjj  /JK  is  an  unbiased  estimate  of  the  variance  of  when  model  (4)  applies 

A 

and,  if  the  normality  assumption  also  holds,  is  independent  of  a_.  (the  customary 
results  when  model  (1)  applies) .  The  distribution  of  is  normal  with  mean  u  and 
variance  (j-l)a2/JK  when  the  normality  assumptiom  applies  and  any  of  models  (2) , 

(3) ,  or  (4)  holds.  These  properties  can  be  used  to  construct  t-statistics  for  in¬ 
vestigating  linear  combinations  of  the  • 

Finally,  p.  is  the  customary  unbiased  estimate  of  g,  for  model  (1)  and  is  free 

of  the  additional  random  terms  for  models  (2)  ,  (5)  ,  and  (6)  .  For  these  extended 

2  A 
models,  s^  /JK  is  an  unbiased  estimate  of  the  variance  of  p,  and,  when  the  normal- 

A 

ity  assumptiom  also  holds  for  the  e..,  is  independent  of  j,  (since  y  is  uncorre- 

2 

lated  with  y  .  -  y.  -yv  +  y  )•  The  statistic  s  /JK  is  an  unbiased  estimate 

A 

of  the  variance  of  pi  when  model  (6)  holds  and,  if  the  normality  assumption  also 


applies,  is  independent  of  ia  (the  customary  model  (1)  results)  .  The  distribution 
*  2 

of  u  is  normal  with  mean  u  and  variance  a  /JK  when  the  normality  assumption  holds 
and  any  of  models  (2)  ,  (5)  ,  (6)  applies.  These  properties  can  be  used  to  construct 
a  t-statistic  for  investigating  u. 
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W  O-WAY  AN OVA  WIffl  INTERACTIONS 
0 .  Summary 

Consider  the  standard  two-way  cross-classification  model  for  ANOVA  with  fixed 
effects  and  interaction.  This  standard  model  is  generalized,  in  many  ways,  by 
addition  of  one,  two,  or  three  more  "error"  terms  that  are  of  different  kinds. 

For  these  extensions,  exact  procedures  are  obtained  for  investigating  all  the 
effects  and  for  investigating  various  subsets  of  these  effects. 

1.  Introduction 

The  balanced  fixed  effects  model  for  two-way  analysis  of  variance,  with  cross¬ 
classification  and  interaction,  is  (Graybill  (1961)) 


y.  *  u  +  a.  +  S  ■  +  y.  •  +  e .  , 

13k  13  ’13  13k 

where  i  =  j  =  1,...,J;  k=l,...,K;  with  I,  J,  K  2  2. 


(1) 


Here,  y  .  is  an  observed  random  variable,  u  is  a  parameter,  a.  is  a  parameter  such 
13k  1 

that  O'  +  . . .  +  a  ~  0,  and  0  .  is  a  parameter  such  that  0  +  ...  +  0=0.  The 

1  I  3  1  J 

y^  are  parameters  such  that  y^  +  ...  +  y^  *  0  for  all  i,  and  y_  +  ...  +  y^  _  Q 

for  all  j.  The  e. are  unobserved  random  variables  that  are  mutually  uncorrelated 
J  13k 

2 

with  zero  mean  and  variance  a  .  When  something  besides  point  estimates  is  desired, 

the  e.  are  also  assumed  to  have  a  joint  normal  distribution!. 

13k 

Sixteen  extensions  of  the  standard  model  (1)  are  given,  and  exact  investigation 

procedures  are  obtained  for  all  of  them.  Each  extension  is  made  by  addition  of  one, 

two,  or  three  more  "error  terms  (that  are  of  different  kinds)  to  the  standard  model 

2 

for  y.  .  One  extended  model  is  such  that  all  of  u,  a  ,  one  or  more  of  the  a. ,  one 
13k  1 

or  more  of  the  B.,  and  one  or  more  of  the  y.  can  be  investigated.  Other  extensions 
3  13 

are  given  for  investigating  subsets  of  these  types  of  effects.  Investigation! 
procedures  customarily  used  for  model  (1)  are  applicable  for  part,  but  not  all,  of 
an  investigation. 
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2.  Extended  Models 


First,  consider  the  extension  where  y,,  a  ,  at  least  one  of  the  or  ,  at  least 


one  of  the  v.  ate  all  investigated.  The  extension  is 
13 

y .  . ,  =  u  +  or.  +  3.  +  y .  .  +  e .  +  e +  e ! '  , 

*i  jk  *  1  3  i3  13k  3k  ik 


(2) 


where,  as  in  the  remainder  of  the  section,  y,  a.,  P . ,  y.  . ,  and  e  have  the  same 

1  j  13  ^3K 

properties  as  for  model  (3)  .  The  additional  random  variables  and  e^  satisfy 


K 

I 

k=l 


K 

Eel.  !  C  =  *  E  e! ' 

=1  3k  k=l  lk 


for  all  i  and  j,  where  the  constant  C  can  have  any  value. 

Second,  consider  the  extension  where  the  types  of  effects  investigated  are 


a  ,  cr  ,  P j ,  y„  .  For  this  case, 


y.  ..  =  y  +  a.  +  P .  +  y.  .  +  e .  .  +  e'  +  e!', 

13k  1  3  ’13  13k  3k  ik 


(3) 


with  the  additional  random  variables  satisfying 


1  e3k  =  cr 

k=i  DK  i 


Selk=C2' 

k=l  lK 


for  all  i  and  j,  where  the  constants  and  C 2  can  have  any  values.  Model  (3)  is 
an  extension  of  model  (2) . 

2 

third,  consider  the  extension  where  the  effects  investigated  are  y,  a  ,  or. 


v. . .  This  extended  model  is 

13 

y.  ..  =  y  +  Of.  +  P,  +  y.  .  +  e.  +  e*  +  e’’, 
13k  13  13  13k  3k  3k 

where  the  additional  random  variables  satisfy  (for  i  =  1,...,  I). 

K  I  J  K 

*»Si  ’  <=•  *  *  .*<•;* +  *ii>  '  °- 

k=l  i=l  3=1  k=1  J 

Model  (4)  is  an  extension  of  model  (2) . 


(4) 


Fourth,  consider  the  case  where  the  types  of  effects  investigated  are  y,  a  , 


P.,  y. . .  The  extension  is 
3  13 
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(5) 


Y.  ^  +  a.  +  3 .  +  Y-  .  +  e.  ..  +  e'  +  e'.', 
iDk  i  D  id  13k  3k  ik 

where  the  additional  random  variables  satisfy  (for  j  *  1,  . . . ,  J) 


K  I  J  K 

I  e'  -  C,  Z  Z  Z  (e *  +  e“)  =  0. 


k=l  J  i=l  j=l  k=l 

Model  (5)  is  an  extension  of  model  (2) . 


jk  ik' 


Fifth,  the  types  of  effects  investigated  are  O  ,  cr,  and  the  extended 


model  is 


y.  =  ^  +  a.  +  B .  +  y  •  •  +  e..,  +  e '  +  e ! , 

13k  1  D  iD  13k  3k  ik' 

where  the  additional  random  variables  e!^  satisfy 


(6) 


Z  eV  =  C, 


k=l 


ik 


(i  1,  I) 


Model  (6)  is  an  extension  of  model  (4) . 

2 

Sixth,  a  ,  ,  Y—  are  types  of  effects  investigated  and  the  extension  is 


y .  . .  *  (i  +  Of.  +  B .  +  y..  +  e..,  +  e '  +  e '  '  , 

13k  1  3  ID  13*  Dk  ik 

where  the  additional  random  variables  e(^  satisfy 


(7) 


Z  e*  «  C, 
k-1  * 


( j  1  #  •  •  •  r  J) 


Model  (7)  is  an  extension  of  model  (5)  . 

Seventh,  consider  the  extension  where  the  types  of  effects  investigated  are 

2 

U,  0  ,  Y  .  Hie  model  is 


y.  ..  =  M,  +  a.  +  B .  +  Y-  •  +  e.  +  e'  +  e!', 
13k  1  3  '13  13k  3k  ik 


(8) 


where  the  additional  random  variables  satisfy 


I  J  K 

i,  J ,<•;* +  •;;>  ■  °- 

1=1  3=1  k*l 


Model  (8)  is  an  extension  of  models  (4)  and  (5) . 
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Eighth,  o  and  Y^j  are  the  types  of  effects  investigated  and  the  extension  is 

y.  ..  ■  (A  +  cr.  +  P.  +  Y-  ■  +  e.  ..  +  e*  +  e!'  .  (9) 

13k  1  ^3  '13  13k  3k  lk 

Model  (9)  is  an  extension  of  models  (6) ,  (7) ,  and  (8) . 

2 

Ninth,  consider  the  case  where  the  types  of  effects  investigated  are  4,  a  , 

<2^,  0  .  The  extended  model  is 

y.  ..  *  p.  +  a.  +  0.  +  y.  .  +  e.  ..  +  e*  +  e''  +  e!'.'  ,  (10) 
13k  1  3  ’13  13k  3k  ik  13 

where  the  additional  random  variables  satisfy  (i=l,...,I;  j=l,...,J) 


r  e!*'  -  C  ,  I  e”’  -  C  ,  r  e”  =  C  , 
i-1  13  1  j-l  13  2  k=l  lk  3 


K  I  J  K 

Ieik  =  c4'  L  1  1  (eik  +  e[k  +  e!V)  =  °' 

k=l  3K  i=l  j=l  k=l  3*  1K  13 


where  the  constants  C^,  C^,  C^,  C4  can  have  any  values,  subject  to  the  triple 

summation,  iiodel  (10)  is  an  extension  of  model  (2)  . 

2 

Tenth,  a  ,  cr,  &.  are  the  types  of  effects  investigated  and  the  extended  model 


y...  *H  +  a.  +p.+Y..  +  e...  +  e '  +  e ! '  +  e ! ' , 

ijk  1  j  ’ij  13k  3k  ik  lj 

where  the  additional  random  variables  satisfy  (i=l,  ...,  I;  j=l,  j) 

j^'  ■  ci' 


E  e! '  =  c,  , 
k-1  lk  3 


r  e'  =  C. . 
3k  4 


Model  (11)  is  an  extension  of  models  (3)  and  (10) . 

2 

Eleventh,  the  types  of  effects  investigated  are  u,  O  ,  ql  and  the  extension  is 
yijk  "  11  +  ®i  +  Bj  +  Yi;j  +  *ijk  +  e!fc  +  e”  (12) 


where  the  additional  random  variables  satisfy  (i*l,  ...,  I) 
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I  J  K 


Eeii'”ci'  Eeli"c2'  s  E  E  (<k  +  eik  +  eii‘)  “  °- 

j-1  13  k-1  lk  2  i-1  j-1  k-1  jk  lk  13 

Model  (12)  is  an  extension  of  models  (4)  and  (10)  . 

2 

IVelfth,  ii,  CT  ,  P  are  the  types  of  effects  investigated  and  the  extended 
model  us 

y.  ..  -  p,  +  a.  +  P.  +  y.  .  +  e.  ..  +  e*  +  e"  +  e!'. '  ,  (13) 

13k  1  3  ’13  13k  3k  ik  13 

where  the  additional  random  variables  satisfy  (j-1,  J) 

I  K  I  J  K 

le!!'  =  C  ,  I  e"  *  C,.  Z  Z  Z  (e*  +  e"  +e! ')  *  0. 

i-1  13  1  k-1  3k  2  i=l  j-1  k-1  3k  lk  13 

Model  (13)  is  an  extension  of  models  (5)  and  (10)  . 

Thirteenth,  the  types  of  effects  investigated  are  O2,  or.,  and  the  extension 


y.  *  H  +  or.  +3.  +  Y.  .  +  e.  ..  +  e*  +  e!'  +  eV. ', 

13k  1  3  13  13k  3k  lk  13 

where  the  additional  random  variables  satisfy  (i-1,  ...,  I) 


Ze!!'  =C„  Z  e!'  =  C0. 

13  1,  ,  ik  2 

3=1  k=l 

Model  (14)  is  an  extension  of  models  (6)  and  (12) . 

2 

Fourteenth,  CJ  ,  P^  are  the  types  of  effects  investigated  and  the  extended 
model  is 

y...  “li  +  Qf.  +  8.  +  y..+e...+e'+e!'+e!’. '  ,  (15) 

•'13k  1  3  ’13  13k  3k  ik  13 

where  the  additional  random  variables  satisfy  (j  *  1,  . . . ,  J) 

I  K 

Z  e”'  -  C.,  Z  e'  -  C_. 

i-1  13  1  k-1  3k  2 

Model  (15)  is  an  extension  of  models  (7)  and  (13) . 

2 

Fifteenth,  p  and  O  are  the  types  of  effects  investigated  and  the  extended 
model  is 
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(16) 


y.  “  lA  +  a,  +  3.  +  y.  .  +  e.  ..  +  e'+  e! '  +  e!  * ' , 
■'ilk  i  i  '13  ilk  ik  lk  13 


where  the  additional  random  variables  satisfy 


I  J  K 
I  E  T.  {• 
i=l  j=l  k=l 


’  +  e!'  +  e! 1 ') 

3*  ik  i] 


0. 


y.  -  p.  +  Of.  +  3.  +  v..  +  e...+e'  +  e !  ’  +  e ! . 

13k  ^1  ]  i]  13k  3k  ik  13 


Model  (16)  is  an  extension  of  models  (8) ,  (12) ,  and  (13) . 

2 

Sixteenth,  the  type  of  effect  investigated  is  0  and  the  extension  is 

(17) 

t  IK  13 

Model  (17)  is  an  extension  of  all  the  other  extensions. 

3.  Basis  for  Investigation 

The  statistics  considered  for  use  are  stated  here,  along  with  the  parameters 
they  investigate,  the  extended  model(s)  for  which  the  additional  random  terms  sum 
out  or  cancel  out,  and  their  pertinent  properties.  At  least  one  statistic  is  in¬ 
troduced  for  each  type  of  parameter  that  is  investigated.  Further  statistics  may 
also  be  introduced  for  use  in  estimating  variances  of  estimates  and/or  for  use  in 
tests  or  confidence  regions. 

For  brevity,  some  of  the  more  evident  probability  properties  for  the  statis¬ 
tics  are  stated  without  justification.  Verification  is  readily  obtained,  for 
example,  from  material  in  Graybill  (1961) .  In  particular,  the  customary  properties 
for  statistics  under  model  (1)  are  obtainable  from  Graybill  (1961) . 

The  additional  notation  for  statistics  is 

A 

v-  -  y 


«i  "  yi..  •  y. 


3 .  =  y  .  -  y 

3  O. 


Vi3 


y.  .  -  y.  -  y  .  +  y 

13 •  1. .  .3  • 


I 

I  (y 

i“l 


1. , 


-  y  ), 


r  (y  .  -  y  )  , 

j«l  -J- 


1  1  (yii  '  yi  •  y  i  +  y  y 
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i  a  k  2 

i-l  j«l  '  Y«-  ‘  Yi  k  '  yo*  +  yi~  +  Y0.  +  S'--K  ‘  y...’  ' 


F  -  JK (J-l) (K-l) S2/S2 , 
3  3  6 


F.  *  IK  (I-l)  (K-l)  S^/S2, 
d  d  e 


F  *  K (K-l) S2/S2. 
g  g  e 

2  2 
The  statistic  S  /(I-l) (J-l) (K-l)  is  an  unbiased  estimate  of  a  and  is  free  of  the 
e 

additional  random  variables  for  all  the  extended  models  considered.  Customarily, 
for  model  (1) ,  the  statistic 

1  l  <17> 

i=1  j=l  k= 1 
2 

would  be  used  instead  of  Sfi.  However,  the  generality  level  is  hugely  increased  by 
2 

use  of  S  ,  and  the  degrees  of  freedom  for  "error"  are  only  reduced  from  IJ (K-l) 
e 

to  (I-l) (J-l) (K-l) .  This  is  not  an  important  reduction  unless  I  and  J  are  small. 

2  2  2 

When  the  normality  assumption  for  model  (1)  also  holds,  S^/ct  has  a  \  -distribution 

with  (I-l)  (J-l)  (K-l)  degrees  of  freedom  for  all  the  extensions. 

2 

The  statistics  S  and  a.  are  free  of  the  additional  random  variables  for 
a  l 

models  (2) ,  (3) ,  (4) ,  (6) ,  (10) ,  (11) ,  (12) ,  and  (14) .  For  each  of  these  models 
2  2  2 

and  normality,  JKS  /a  has  a  x  -distribution  with  I-l  degrees  of  freedom.  Also, 

3 

under  the  null  hypothesis  that  all  the  a ■  are  zero,  F  has  an  F-distribution  with 

X  3 

I-l  and  (I-l) (J-l) (K-l)  degrees  of  freedom.  This  is  verified  by  showing  that  the 

y.  ,  -  y  are  uncorrelated  with  all  of  the  (y.  -  y.  .  -  y.  .  -  y  ..  +  y. 

i  ••  ...  iJK  iD  *  i.k  OX  i  •  •  + 


y  .  +  y  -  y  ) ,  which  also  shews  that  all  the  a.  are  independent  of  S  for  the 

•3*  *«K  ««f  X  6 

A 

normality  case.  The  statistic  or,  is  an  unbiased  estimate  of  cr  for  the  stated 

2  2 

models  and  has  variance  CT  /JK,  which  is  estimated  by  S  /JK.  Its  distribution  is 

e 

normal  for  the  normality  case.  These  properties,  including  independence  with  , 
provide  a  basis  for  constructing  t-statistics  to  investigate  specified  linear 
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combinations  of  the  a.  (for  the  normality  case)  . 

1 

2  * 

The  statistics  S,  and  3.  are  free  of  the  additional  random  variables  for 
b  3 

models  (2)  ,  (3)  ,  (5)  ,  (7)  ,  (10)  ,  (11)  ,  (13)  ,  and  (15) .  With  any  of  these  models 
2  2  2 

and  normality,  IKS^/CT  has  a  x  -distribution  with  J-l  degrees  of  freedom.  When 

also  the  null  hypothesis  that  all  the  6.  are  zero  holds,  F,  has  an  F-distribution 

2  b 

with  J-l  and  { I — 1) (J-l) (K-l)  degrees  of  freedom.  This  is  proved  by  showing  that 

the  y  ,  -  y  are  uncorrelated  with  all  of  the  (Y  -  y.  .  -  y.  ,  -  y  + 

-3  •  ...  i]k  '13.  'i.k  *.jk 

y.  +  y  +  y  -  y  ) ,  which  also  proves  that  all  the  6.  are  independent  of 

1  •  •  *3*  »  «k  •  •  • 

S  for  the  normality  case.  The  statistic  9.  is  an  unbiased  estimate  of  B.  for  the 
e  3  3 

2  * 
stated  models  and  has  variance  O  /IK.  When  the  normality  assumption  holds,  B  has 

a  normal  distribution.  Thus,  for  normality,  t-statistics  (using  s  )  can  be  con¬ 
structed  for  investigating  specified  linear  combinations  of  the  B  . 

2 

The  statistics  S  and  y.  .  are  free  of  the  additional  random  variables  for 
g  13 

2  2  2 

models  (2)  -  (9) .  For  these  models  and  normality,  K sQ/~^  has  a  x  -distribution 
with  (1-1) (J-l)  degrees  of  freedom.  Also,  under  the  null  hypothesis  that  all  the 
j  are  zero,  F^  has  an  F-distribution  with  (1-1)  (J-l)  and  il-l)  (J-l)  (K-l)  degrees 
of  freedom.  This  is  verified  by  showima  that  the  >'y ,  -  y  ,  -  y  ,  +  y  ) 

are  uncorrelated  with  all  the  (y.  \  .  .  -  y.  ,  -  v  +  y  +  y  ,  - 

y  ) ,  which  also  proves  that  all  the  y.  are  independent  :f  3  for  the  case  of 

13  e 

normality.  The  statistic  y.  .  is  an  unbiased  estimate  of  v  for  models  (2)  -  (9) 

13  13 

2 

and  has  variance  c  /K.  The  distribution  of  is  normal  when  the  normality  as¬ 
sumption  is  satisfied.  Hence,  t-statistics,  using  S  ,  can  be  developed  for  inves- 

e 

tigating  specified  linear  combinations  of  the  y for  the  case  of  normality. 

The  statistic  -  is  free  of  the  additional  random  variables  for  each  of  models 

(2)  ,  (4)  ,  (5'<  ,  ■!?'  ,  1 10 )  ,  (12)  ,  (13)  ,  and  (16)  .  The  statistic  u  is  an  unbiased 

2  2 

estimate  of  ..  .or  these  models  and  has  variance  0  /IJK  (estimated  by  S  /IJK) .  The 

e 


d  j  s '.nation  of  -  is  normal,  and  u  is  independent  of  S^,  for  the  normality  case. 
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This  independence  follows  from  zero  correlation  of  u  with  all  of  the  (y  -  y. . 

a.  3k  ■'13. 


y(  v  -  y  +  y.  +  y  .  +  y  v  -  y  )  •  Th»s,  under  normality 

[l(I-l)J(J-l)K(K-iy  ]1/2  (d  _  u)/s 


has  a  t-distributiom  with  ( I  —  1)  (J-l)  (K-l)  degrees  of  freedom,  and  can  be  used  for 
investigating  |i. 


Y 
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CHAPTER  VI 


EXTENSIONS  OF  MODELS  HAVING  RANDOM  EFFECTS, 
WITH  INVESTIGATION  OF  ALL  EFFECTS 


ONE-WAY  ANOVA  MODEL 
0 .  Summary 

Considered  is  the  standard  one-way  ANOVA  with  random  effects  (va^ianc  compo¬ 
nents  model) .  This  standard  model  is  generalized  in  several  ways.  For  these  ex¬ 
tensions,  exact  results  are  developed  for  investigating  the  -ran  and  both  variance 
components  (of  the  standard  model)  and  for  investigating  subsets  of  these  param¬ 
eters.  Customary  procedures  for  the  standard  model  remain  usable  for  some  investi 
gations  and  extensions,  but  more  general  models  are  applicable  when  use  of  custom¬ 
ary  results  is  not  required. 

1.  Introduction 

The  balanced  random  effects  (variance  components)  model  for  one-way  ANOVA  is 
(see  Graybill  (196 11) 


y  ..  =  ll  +  a  .  +  b..  , 
1  Ik' 


(1) 


where  j  =  1,...,J  and  k  =  1, . . . ,K  with  J,  K  2  2.  Here,  y  is  an  observed  random 

Jk 

variable,  u  is  a  parameter,  the  a_.  are  unobserved  random  variables  with  zero  mean 

2 

and  the  same  variance  0  ,  the  b.,  are  unobserved  random  variables  with  zero  mear. 

a  jk 

2 

and  the  same  variance  O.  ,  and  the  a.,  b  ,  are  mutually  uncorrelated.  When  some- 

b  1  Jk 

thing  other  than  a  point  estimate  is  desired,  the  a.,  b  are  also  assumed  to  have 

J 

a  joint  normal  distribution. 

Five  extensions  of  the  standard  model  (1)  are  given.  Each  extension  if.  made 


by  addition  of  one  or  two  types  of  "error"  terms  to  the  standard  model  for  y_.  ^ • 

2  2 

One  extension  is  such  that  all  of  u,  a  ,  and  0  can  be  investigated  by  methods 

a  b 

with  exactly  determined  properties.  Not  all  of  the  statistics  for  this  investiga¬ 


tion  are  the  same  as  those  customarily  used  for  model  (1) .  Other  extended  models 


2  2  2 

are  given  for  investigating  o  and  o.  ,  and  for  investigating  a  .  The  customary 

d  D  D 

procedures  are  applicable  for  some  of  these  extensions  but  different  procedures  are 
used  for  the  others. 

2 .  Extensions 

The  extended  models  depend  on  the  parameters  to  be  investigated  and  on  whether 

the  investigation  procedures  are  limited  to  those  customarily  used  for  model  (1) . 

2  2 

First,  consider  the  extension  where  all  of  p,,  a  ,  and  0  are  investigated. 

cl  D 

Restriction  to  the  customary  procedures  does  not  apply  to  this  case.  The  extended 
model  is 

yjx  ■  11  +  *j  +  bjk  +  V  IJ> 

where,  as  in  the  remainder  of  the  section,  p,,  a.,  and  b  have  the  same  properties 

3 

as  in  model  (1) .  The  additional  random  variables  e1f...,e  sum  to  zero. 

J.  X 

2  2 

Second,  consider  the  extension  where  a  ,  C  are  investigated  and  the  proce- 

a  d 

dures  for  use  are  not  restricted.  For  this  case, 

yjk  '  »  +  *5  +  V  +  *  V  <3) 

Model  (3)  is  a  generalization  of  model  (2) . 

Third,  consider  the  case  where  the  procedures  are  limited  to  those  customarily 

2  2 

used  for  model  (1)  and  both  0  and  0.  are  investigated.  The  extension  is 

a  b 

y  ■  p  +  a .  J  b .  .  +  e* .  (4) 

Jjk  3i] 

Model  (4)  has  the  lowest  generality  level  of  the  stated  extensions  and  is  much  less 
general  than  model  (2)  when  K  2  3. 
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consider  investigation  of  .  The  extension  is 

yjk‘u  +  1j  +  bix+e"j-  161 

Model  (6)  is  appreciably  less  general  than  model  (5) .  However,  as  can  be  easily 
shown,  model  (6)  is  the  most  general  of  the  stated  extensions  for  which  the  type 
of  method  for  rejection  of  outliers  that  was  outlined  previously  is  applicable. 

3.  Basis  for  Procedures 

This  section  contains  a  statement  of  the  statistics  considered  for  possible 
use,  the  parameters  they  investigate,  the  extended  model(s)  for  which  they  are 
usable,  and  their  pertinent  properties.  For  an  investigation,  at  least  one  statis¬ 
tic  occurs  for  each  of  the  types  of  parameters  investigated. 

Some  of  the  more  evident  probability  properties  for  the  statistics  are  stated 
with  no  verification.  Justification  is  easily  obtained,  for  example,  from  material 
given  in  Graybill  (1961) .  Also,  the  customary  properties  can  be  obtained  from 
Gray  bill  (1961)  . 

The  additional  notation  used  is 

A  2  J  2 
U  =  y  ,  s  =  I  (y  -  y  )  , 

*  *  ®  J  * 


J  K  22JK 

sl  =  1  1  (Yik"yj  )  5=11  (y.k-y.  -y  +y  )  . 

A  j=2.  jc*l  J  z 


Fal  *  MS.Vb-IIIj1,  -  KOC-US^/S,2. 


2  2 
The  statistic  S,  /J  (K-l)  is  the  customary  unbiased  estimate  of  0.  and  is  free  of 
x  o 


the  additional  random  variables  for  models  (4)  and  (6) .  With  these  models  and  the 


2  2  2 

normality  assumption  (for  the  a.  and  b  ),  S  /a  has  a  \  -distribution  with  J (K-l) 

3  3k  1  b 


degrees  of  freedom.  The  statistic  S /(J-l) (K-l)  is  an  unbiased  estimate  of 


a.  and  is  free  of  the  additional  random  error  terms  for  all  of  the  extended  models 
b 


2  2  2 

For  all  the  models  and  normality,  S.  /a  has  a  v  -distribution  with  (J-l) (K-l) 

2  b 


degrees  of  freedom. 


2 

The  statistic  S  is  free  of  the  additional  random  variables  for  models  (2)  , 

a 

2  2  2  2 

(3)  ,  and  (4)  .  For  these  models  and  normality,  KS  /  (0  +  KO  )  has  a  x  -distri- 

an  a 

bution  with  J-l  degrees  of  freedom.  With  model  (4)  and  normality,  F  has  an  F- 

ax 

distribution  with  J-l  and  J(K-l)  degrees  of  freedom  under  the  null  hypothesis  of 
2 

a  *  0.  which  is  the  customary  result  when  model  (1)  applies.  For  this  hypoth- 
a 

esis,  normality,  and  any  of  models  (2)  ,  (3)  ,  or  (4)  ,  the  statistic  F  ^  has  an  F- 

distribution  with  J-l  and  (J-l) (K-l)  degrees  of  freedom.  This  is  verified  by 

showing  that  y.,  -  y  is  uncorrelated  with  y.  -  y.  -  y  .  -  y  for  all  j',j,k. 

3  •  •  •  3*  3  •  •  • 

The  statistic 

S  2  (J-l)-1  -  S  2lJK(K-l)]_1 
a  x 

2 

is  an  unbiased  estimate  of  0  when  model  (4)  holds,  and 

a 

S  2  (j-l)"1  -  S  2  (if  (J-l)  (K-l)  j"1 
a  z 

2 

is  an  unbiased  estimate  of  cr  when  any  of  models  (2)  ,  (3)  ,  (4)  applies. 

a 

A 

Finally,  va  is  the  customary  unbiased  estimate  of  y.  for  model  (1)  and  is  free 

of  the  additional  random  terras  for  model  (2)  .  When  the  normality  assumption  holds, 
-  2 

h  is  independent  of  S  ,  which  is  the  customary  result  for  model  (1) .  Thus,  under 

a 

normality 

[j(j-l)]1/2(il  -  \x)/s 

a 

has  a  t-distribution  with  J-l  degrees  of  freedom,  which  is  a  customary  result  for 
model  (1) .  Incidentally,  the  customary  results  for  model  (1)  are  usable  when  only 
^  is  investigated  by  use  of  model  (2) . 

TWOFOLD  NESTED  A NOVA 
0 .  Su  Binary 

Consider  the  sta  iard  twofold  nested  design  for  analysis  of  variance  with 
random  effects  (a  variance  components  model) .  For  these  extensions,  exact  proce¬ 
dures  are  obtained  for  investigating  all  of  the  mean  effect  and  the  three  types  of 
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variance  components,  and  for  investigating  various  subsets  of  these  parameters. 

Most  of  the  investigation  procedures  are  different  from  those  customarily  used  for 
the  standard  model. 

1.  Introduction 

The  balanced  twofold  nested  analysis  of  variance  model  with  random  effects  is 
(Graybill  (1961)) 

y...=g,+  a.  +b..+c...,  (1) 

13k  K  l  13  13k 

where  i  *  1,...,I;  j  =  1,...,J;  k  =  1,...,K;  with  I,J,K  ^  2. 

Here,  is  an  observed  random  variable,  |i  is  a  parameter,  the  are  unobserved 

2 

random  variables  with  zero  mean  and  variance  C  ,  the  b. .  are  unobserved  random 

a  13 

2 

variables  with  zero  mean  and  variance  0.  ,  the  c. are  unobserved  random  vari- 

b  13k 

2 

ables  with  zero  mean  and  variance  0^  ,  and  the  random  variables  are  mutually  un¬ 
correlated.  When  significance  tests  or  confidence  regions  are  desired,  the  random 
variables  are  also  assumed  to  have  a  joint  normal  distribution. 

Seven  extensions  of  model  (1)  are  given,  and  exact  investigation  procedures 
are  obtained  for  all  of  them.  Each  extended  model  is  obtained  by  addition  of  one, 

two,  or  three  random  terms  (of  an  "error"  nature)  to  the  righthand  side  of  model 
.  ,  .  2  2  2 

(1)  .  One  extension  is  such  that  all  of  11,  0  ,0,0  can  be  investigated  simul- 

a  b  c 

taneously.  Other  extensions  are  given  for  investigating  various  subsets  of  these 
parameters.  Investigation  procedures  customarily  used  for  model  (1)  are  usable  in 
some  cases,  twt  many  of  the  procedures  are  not  customarily  used  for  the  standard 
model . 

2.  Extended  Models 

2  2  2 

First,  consider  the  extension  for  the  case  where  all  of  11,  0  ,  0.  ,  0  are 

a  b  c 


investigated.  The  model  is 


y...  “(i  +  a.  +b..+c...  +e'.,  +  e' '  , 
13*  1  ij  13*  ik  3k 


(2) 


where,  as  in  all  the  extensions,  (i,  the  a,  ,  the  b.  and  the  c.  have  the  same 

1  13'  13k 
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properties  as  in  model  (1) .  Ttoe  additional  random  variables  satisfy 


E  e'  -  C  -  -  E  e*' 
k=l  lk  k=l  3k 

for  all  i  and  j,  where  the  constant  C  can  have  any  value. 

2  2  2 

Second,  consider  the  extension  where  0  ,  a,  ,  0  are  investigated.  The 

a  b  c 

extended  model  is 

y.  .  =  M.  +  a.  +  b.  .  +  c  +  e'  +  e'.',  (3) 

-'ljk  l  13  13k  lk  3k 

where  the  additional  random  variables  satisfy 

J-^ik  =  Cl'  kf!ej*  =  C2' 

for  all  i  and  j,  where  the  constants  and  C 2  can  have  any  values.  Model  (3)  is 

an  extension  of  model  (2) . 

2  2 

Third,  0,  and  0  are  the  parameters  investigated  and  th«  extended  model  is 
b  c 

y..,  =p.+  a.  +b..+c...  +e'  +  e’.’,  (4) 

^ljk  1  13  13k  ik  3k 

where  the  additional  random  variables  satisfy 


E  e! '  C,  ( j=l, . . . ,J) . 

k=  1  3 

Model  (4)  is  an  extension  of  model  (3) . 

2 

Fourth,  only  0  is  investigated  and  the  extension  is 
c 

y.  ..  =  11+  a.  +  b..  +  c...  +  e '  +  e '  +  e '  !  '  . 

13k  1  13  13k  ik  3k  13 

Model  (5)  is  an  extension  of  model  (4) . 

2 

Fifth,  u  and  0^  are  to  be  investigated  and  the  extended  model  is 

y...  =  y,  +  a.  +  b..  +  c.  +  e*  , 

13k  1  13  13k  13k 

where  the  e*  ..  satisfy 
13k 


I  e*  =  0, 

k-1  13k 


(i  1 1  •  •  .  1 1 ;  • 
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Model  (6)  is  an  extension  of  model  (2) . 


Sixth,  only  p.  is  to  be  investigated  and  the  extension  is 


y,  =  u.  +  a.  +  b.  .  +  c .  ..  +  e* , 
13k  1  13  13k  13k 


(7) 


where  the  e*  satisfy 
13k 


J  K 

E  It?.  =o, 

3=1  k=l 


(i=l, . . . ,1)  . 


Model  (7)  is  an  extension  of  model  (6) . 

2 

Finally,  only  C  is  to  be  investigated  and  the  extended  model  is 

cl 


y . 


ijk  *  p.  +  a  .  +  b.  .  +  c.  +  e*  .  , 
1  13  13k  13k 


(8) 


where  the  e*  satisfy 
13k 


K 

E  ei3k  =  C' 
k=l  11 


( i~  1 , . . . ,  I ;  ■ 


Model  (8)  is  an  extension  of  model  (3)  and  of  model  (6) . 

3.  Oitline  of  Procedures 

Limitation  to  consideration  of  seven  sets  of  the  parameters  is  due  to  the  two¬ 
fold  nested  classification.  These  are  the  combinations  that  are  meaningful  for 

2  2 

investigations.  For  example,  investigation  of  c  and  0^  is  not  meaningful, 

2  2 

because  the  statistic  for  investigating  a  is  needed  for  investigation  of  0.  . 

c  b 

•  2  2 

Thus,  when  investigation  of  a  and  a,  is  desired,  the  case  considered  is  inves- 

a  b 

2  2  2 

tigation  of  0  ,  G.  ,  0 

a  d  c 

The  statistics  for  use  in  the  investigation  procedures  are  stated  here,  along 
with  identification  of  the  parameter (s)  they  are  used  to  investigate,  the  extended 
models  for  which  they  apply,  and  their  pertinent  properties.  For  simplicity,  some 
of  the  more  obvious  probability  properties  for  the  statistics  are  given  without 
verification.  Justification  of  these  stated  properties  can  be  obtained,  for 
example,  in  Graybill  (1961). 
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The  extra  notation  used  is 


li  =  y 


s  2  =  JK  2  (y .  -y  )2 
a  i-l  1 . 


I  J 
K  E  E  (y. 


i-l  j-1 


13  •  ~  yi  •  ' 


•c  ‘  £  jfj  '  ya.  '  yi*  *  yi..  *  yo-  +  y..k  ‘  *...»  • 

F  "  I(J-1)S  2/(I-l)Sv2,  F-  =  (I-l)  (K-l)  S  2/IS  2. 
a  abb  be 

2  2 
The  statistic  s  /(i-l)  (J-1)  (K-l)  is  an  unbiased  estimate  of  a  and  is  free  of  the 
c  c 

additional  random  variables  for  all  the  estensions  considered.  When  the  normality 

2  2  2 

assumption  for  model  (1)  is  also  satisfied,  s  /a  has  a  y  -distribution  with 

c  c 

(I-l)  (J-1)  (k-l)  degrees  of  freedom  for  all  the  extended  models. 

2 

The  statistic  s,  is  free  of  the  additional  random  variables  for  extended 
b 

2 

models  (2)  ,  (3)  ,  (4)  ,  (6)  ,  and  (8)  .  For  these  models,  s.  /I  (J-1)  is  an  unbiased 

b 

2  2  2  2  2  2 
estimate  of  a  +  Kc,  .  When  normality  also  holds,  s,  /  (ct  +  Ka,  )  has  a  y  -dis- 
c  b  b  c  b 

tribution  with  I (j-1)  degrees  of  freedom.  For  models  (2)  ,  (3)  ,  (4)  and  normality, 

2  2 

s,  is  independent  of  s  ,  so  that  F,  has  an  F-distribution  with  I  (J-1)  and  (I-l) 
b  c  b 


(J-1) (K-l)  degrees  of  freedom  under  the  null  hypothesis  that  -  0.  Independence 
2  2 

of  s^  and  s^  is  verified  by  showing  that  the  y^,_.,  -  y^t  are  uncorrelated  with 


all  of  the  (y.  .. 

13k 


y..  -  y.  ,  -  y  +  y.  +  y  .  +  y  .  -  y  ).  Hie  statistic 

13.  i.K  -J*  1-.  O-  ••• 


[s^/KJ-l)  -  Sc2/(I-1)  (J-1)  (K-l)  ]/K 


is  an  unbiased  estimate  of  O  for  models  (2)  ,  (3)  ,  and  (4)  . 

b 

2 

The  statistic  s  is  free  of  the  additional  random  variables  for  models  (2)  , 
a 

2 

(3)  ,  (6)  ,  (7)  ,  and  (8)  .  For  these  models,  s^  /(I-l)  is  an  unbiased  estimate  of 

222  22222 
a  4*  Kcr  +  JKa  .  When  normality  also  holds,  s  /(a  +  Ko.  +  JKa  )  has  a  x  “ 

eba  aeba 


distribution  with  I-l  degrees  of  freedom  and  is  independent  of  s^  (a  customary 
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2 

result) .  Thus,  under  the  null  hypothesis  that  a  “0,  the  statistic  F  has  an 

cl  3 

F-distribution  with  I  -  1  and  I(J-l)  degrees  of  freedom.  The  statistic 

[S  2/(I-l)  -  s,  2/I(J-l)  ]/JK 
a  b 

2 

is  an  unbiased  estimate  of  a  for  extensions  (2)  ,  (3)  ,  (6)  ,  and  (8)  . 

a 

Finally,  the  statistic  y,  is  free  of  the  additional  random  variables  for  models 

A 

(2)  ,  (6)  ,  and  (7)  .  For  these  models,  y,  is  an  unbiased  estimate  of  y  and  the 

A 

variance  of  |i  is 

(a  2  +  Ka  2  +  JKa  2)/ijk, 
c  d  a 

2 

which  is  unbiasedly  estimated  by  the  statistic  s  /I(I-1)JK.  When  the  normality 

a 

a  2 

assumption  also  holds,  [i  is  independent  of  s  (a  customary  result)  and  the 

a 

statistic 

[i(I-l)  JK]‘5(y,-n)/s 

a 

has  a  t-distribution  with  1-1  degrees  of  freedom. 
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CHAPTER  VII 


EXTENSIONS  FOR  ANALYSIS  OF  COVARIANCE  MODEL 
AND  MIXED  MODEL 

ONE-WAY  ANALYSIS  OF  COVARIANCE  MODEL 
0 .  Summary 

Considered  are  extensions  of  the  standard  one-way  classification  model  for 
analysis  of  covariance  that  has  fixed  effects.  For  these  extensions,  nearly  all  of 
the  customary  investigation  procedures  are  shown  to  have  the  same  properties  as  for 
the  standard  model.  An  extended  model  can  be  developed  for  a  case  where,  in  the 
statistic (s)  used  for  the  investigation,  the  observations  occur  exclusively  in  the 
form  of  their  differences.  An  application  to  rejection  of  outlying  observations 
is  discussed. 

2 .  Introduction 

The  standard  model  for  the  balanced  one-way  classification  in  analysis  of 
covariance  is 

yjk  =  g.  +  Oj  +  exjk  +  ejk,  (1) 

where  j  =  1,...,J  and  k  =  1,...,K,  with  J,K  ^  2.  Here,  y..  is  an  observed  variable, 
Xjk  is  a  concomitant  variable  with  fixed  known  value,  li  ana  8  are  parameters,  or^ 
is  a  parameter  such  that  ar^  +  . ..  +  c/j  m  0,  and  e^k  is  an  unobserved  random  vari¬ 
able.  The  x..  are  such  that  there  is  at  least  one  value  of  j  for  which  x.,,...,x., 

]k  J  3I  3k 

are  not  all  equal.  The  e^k  are  assumed  to  be  uncorrelated  with  zero  expectation 

2 

and  the  same  positive  variance  c  .  They  are  also  assumed  to  have  a  joint  normal 

distribution  when  something  other  than  a  point  estimate  is  desired. 

A  basis  for  rejection  of  outlying  observations  is  outlined  first,  suppose  that, 

without  knowledge  of  the  observed  values,  Yj^*  is  chosen  to  be  investigated  as  a 

possible  outlier.  On  the  basis  of  the  known  values  for  x^,...,Xjk,  but  without 

knowledge  of  the  observation  values,  divide  y  ,..., y  into  sets  if  size  three  and 

3 1  jK 


also  zero,  one,  or  two  sets  of  size  four  (with  y  not  in  a  set  of  size  four) . 

Any  set  of  size  four  is  converted  to  a  set  of  size  three.  This  is  accomplished  by 
adding  two  of  its  observations  and  dividing  this  sum  by  / 2  ,  to  yield  one  "obser¬ 

vation."  This  "observation"  is  designated  as  y  , ,  where  k'  is  the  smaller  of  the 
values  of  k  for  the  two  observations  added.  For  each  set  (now  all  of  size  three) , 
develop  a  statistic  of  the  form 

(2) 


Vjk(l)  +  3Yjk(2)  +  by jk (3)  ’ 


where 


1  +  a  +  b  =  0 

x  +  ax.,  +  bx.,  =0, 

Dk(l)  }k  (2)  :k(3) 

and  k(l)  =  k*  for  the  set  containing  y  .  The  division  into  sets,  the  conversion 
of  sets  of  size  four  (if  any)  ,  and  the  choice  of  k(l)  ,  k(2)  ,  k(3)  within  a  set,  is 
such  that  solutions  exist  for  a,  b  and  also  the  statistic  (2)  for  the  set  contain¬ 
ing  y.v*  has  the  smallest  variance,  subject  to  k(l)  =  k* . 

Let  a  =  A  and  b  =  B  for  the  statistic  that  includes  y  ^  and  multiply  the 


statistic  (2)  for  any  other  set  by 


(A2  +  B2  +  1)  (a2  +  b2  +  1)  . 

The  resulting  statistics  do  not  involve  u,  3,  or  the  .  They  are  mutually  uncor¬ 
related  with  zero  mean  and  have  the  same  variance.  With  normality  assumed,  the 

statistic  containing  y  can  be  investigated  by  a  procedure  for  examining  whether 

3* 

a  specified  (without  knowledge  of  the  observation  values)  observation,  supposedly 
in  a  sample  from  a  normal  population  with  zero  mean,  is  an  outlier. 

The  jxirpose  of  this  paper  is  to  show  that  nearly  all  of  the  exact  results  de¬ 
veloped  for  model  (1)  remain  exact  when  this  model  is  generalized.  Three  kinds  of 
extended  models  are  considered. 

2.  Extended  Models 
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V 
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which  is  used  in  expressing  the  statistics  considered. 


All  statistics  used  for  investigation  of  a  are  proportional  to 

a2  =  (E  -  E  2/E  )[k(J-1)-  l]-1. 

yy  xy  xx 

The  statistics  for  investigation  of  &  are 


3  =  E  /E 

xy  xx 


and 


The  statistic 


(K-l)  O2 


0 


*2  *2 
B  e  /ct  . 

XX 


(T  +  E  ) 

T  +  E  +  — - SL_ 

yy  yy 


T  +  E 
xx  xx 


yy 


is  used  to  test  a. 


..  =  a  -  0.  Investigation  of  individual  O'.,  or  linear 
J  1 


combinations  of  them,  can  be  developed  from  use  of 


or .  =  y  -  y  -  9  (x  ,  -x  )  . 

J  J*  ••  J  •  •  • 


Tests  and  confidence  intervals  for  linear  combinations  of  the  a.  are  based  on  o 

1 

and  the  corresponding  to  the  occurring  in  the  linear  combination. 

SCHEFFf  TWO-WAY  MIXED  MODEL  FOR  ANOVA 
0 .  Summary 


12 


Considered  is  the  mixed  model  for  two-way  ANOVA  that  was  introduced  by  Scheffe 
including  a  joint  normality  assumption  when  tests  or  confidence  regions  are  desired 


This  model  is  extended  in  several  ways.  For  these  extensions,  the  effects  ordinar¬ 


ily  considered  for  the  Scheffe  model  can  still  be  investigated.  Some  of  the  inves¬ 
tigation  procedures  differ  from  those  developed  by  Scheffe. 

1.  Introduction  and  Discussion 

The  Scheffe  mixed  model  for  ANOVA  can  be  stated  in  the  form 


i'K 


+  b .  +  c .  .  +  e  .  . ,  , 
i  3  U  JO* 


(1) 


where  i  =  1 . I;  ;  *  1,.  .  ,J;  k=l  .  .,K;  with  I,J,K  ^  2. 

Here  .  -=  ar.  observed  random  variable,  u  is  an  unknown  parameter,  and  the  y 


are  -..cov-  Parameters  such  that  y.  +  ...  +  a  =0.  The  b.  are  unobserved  random 

1  I  3 

variables  with  zero  expectation  that  are  uncorrelated  and  have  the  same  unknown 

variance  z*  .  The  c.  are  unobserved  random  variables  with  zero  expectation  and 
B  13 

such  that 


E  c.  =  0 , 
i=l  1; 


(j  =  1, . .  .,J)  . 


The  unknown  value  of  var(c. .)  is  the  same  for  all  j  and  is  denoted  by  a..,  which 

13  ii 


a  parameter  of  the  set  ch  ,  (i,i*  =  1, . . .  ,1)  ,  with  |  |  cr^ ^ , 
indefinite.  Also,  cov(c  „  ,c^,  ^ ,)  =  0  for  j  J*  j'  and 


symmetric  and  positive 


cov  (c .  .  ,c  . ,  -  <7...  -  c.  -  o  .  ,  +CT 

13  13  11  1.  .1 


where 


^  CTii,//X'  a  i*  ^  aii,// 1' 
i’=l  11  -1  i=l 


a  =  £  a.  /I . 

•*  i=l  "• 


In  addition, 


cov  (b  .  ,c  .  . )  =  a  -  o 
3  13  1. 


and  cov(b.,c.  .  ,)  is  zero  for  :  7  3' .  Finally,  the  e.  are  unobserved  random  van- 
3  13 ’  J  J  13k 

ables  of  an  error  nature  that  have  zero  expectation  and  the  same  unknown  variance 

2 

a  .  The  e. ,,  are  mutually  uncorrelated  and  are  uncorrelated  with  the  b  and  the 
e  ijk  3 


c 

1 1  ■ 


When  tests  or  confidence  regions  are  considered,  the  b.,  the  c.  ,  a.  the  e. 

1  i  J  i 3* 

are  assumed  to  have  a  joint  normal  distribution. 

The  ^fects  investigated  are  one  or  more  of  the  p.  (=p,+cr)  ,  one  or  more  of  the 
including 


ct  2  =  (i-l)  _1  E  a.2, 
A  i-l  1 


a  ,  one  or  more  of  the  a.  , 

B  li 


W 

1=  1 

2  2 

and  cr  .  Of  course,  O’  can  be  investigated  by  procedures  for  investigating  one 
or  more  of  the  a  .  Scheffe  gives  procedures  for  investigating  these  parameters 


in  Scheffe  (1956)  and  (1959) . 


Ten  extensions  of  model  (1)  are  given.  Each  extended  model  is  formed  by 

addition  of  one,  two,  or  three  more  random  error  terms  to  the  righthand  side  of 

equation  (1)  .  One  extension  is  such  that  one  or  more  of  the  one  or  more  of  the 

2  2 

O'.,  CJ  ,  one  or  more  of  the  a...,  and  c  can  be  simultaneously  -  ..vestiaated . 
l  B  n'  e 

Appropriate  subsets  of  these  types  of  parameters  car,  bo  investigated  for  the  other 

extensions.  The  procedures  developed  by  Scheffe  for  model  (1)  are  applicable  in 

2 

some  cases  but  a  different  "error  sum  of  squares"  s  is  used  for  other  cases.  The 

e 

2 

degrees  of  freedom  associated  with  s  arc  (I-l)  ( J  —  1)  ( K  —  1 )  while  IJ(K-l)  dearees  of 

e 

freedom  are  associated  with  the  error  sum  of  squares  used  by  Sheffe.  Use  of  s  ‘  is 

t:‘ 

the  only  way  the  procedures  for  the  extensions  differ  from  those  developed  by 
Sche  f  fe . 

2.  Extended  Models 

First,  consider  the  extended  model  for  the  case  where  all  of  one  or  m.  re 
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2  2 

the  p,.  (=m,+q'.)  ,  one  or  more  of  the  a.  ,  one  or  more  of  the  a.  ...  O  ,  and  a  can  be 

11  i  ii '  B  e 

simultaneously  investigated.  Ttiis  model  is 


y.  ..  =  (|J.  +  Of.)  +  b.  +  c.  .  +  e.  .  +  e*  +  e!', 

13k  l  3  13  13k  lk  3k 


(2) 


where,  as  for  all  extended  models,  the  a.,  the  b.,  the  c. .  ,  and  the  e. have 

1  3  ID  13* 

the  same  properties  as  for  model  (1)  .  The  extra  random  errors  e1.,  and  e'.,'  satisfv 

lk  3k 


k=l 


ik 


k=l^k 


for  all  i  and  j,  where  the  value  of  the  constant  C  is  arbitrary. 

Second,  consider  the  extension  where  the  types  of  parameters  considered  are 
2  2 

the  a. 1  the  a. . , ,  o  ,  and  a  .  The  extension  is 
1  ii*  B  e 

y.  ..  =  (u  +  Of.)  +  b.  +  c.  .  +  e.  ..+  e!,  +  e'. ',  (3) 

13k  1  3  13  13k  ik  3k' 

where  the  additional  random  variables  satisfy 


E  elk  =  Cl' 

k=l  1K  1 


Z  e’*  =  c„, 
3*  2 
k=i  J 


for  all  i  and  3,  with  the  constants  and  C having  arbitrary  values.  Model  (3) 
is  an  extension  of  model  (2) . 

2 

The  third  extended  model  involves  .simultaneous  investigation  of  the  <y^,  , 

and  a  .  The  model  is 
e 


y .  ..  =  (H  +  ar . )  +  b.  +  c..  +  e...  +  e’  +  e' ’  , 
13k  1  3  13  13k  ik  3k 


(4) 


where  the  e!,  satisfy 
ik 


I  e*  =  C. 

k-1  lK 


Modex  (4)  is  an  extension  of  model  (3) . 


2  2 

Fourth,  consider  the  extension  for  investigation  of  the  ,  and  o^  . 


The  mod e 3  is 


y.  ..  =  (H  +  a.)  +  b.  +  c.  +  e  +  e’  +  e’ ’  , 
13k  1  3  13  13k  ik  3k 


(5) 
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where  the  e*  and  e'*  satisfy 
lk  3k 


K 


£"1* +  *ji>  ' 0 


for  all  i,j.  Model  (5)  is  an  extension  of  model  (2) . 

rAB 

ijk  T  eik  T  ejk* 


2  2 

Fifth,  the  parameters  investigated  are  (j  ,  C  and  the  extended  model  is 


yijk 


(|1  +  cr . )  +  b.  +  c  .  .  +  e  .  +  e*  +  e1 

i  T  IT  1  -\V  'iV 


3  13 

Model  (6)  is  an  extension  of  model  (5) . 

2  2 

Sixth,  the  |i.,  cr_  ,  and  a  are  investigated.  The  extension  is 
i  B  e 


yijk 


(ji  +  Of.)  +b.  +c..+e...  +  e'  +  e'.'  +  e!V 
l  3  13  13k  1k  3k  13 


where 

K 

e'*  =  C  ,  £  e!*'  =  C  , 

k=l  3,5  1  j  =  l  13  2  k=l 

for  all  i,j.  Model  (7)  is  an  extension  of  model  (2) . 

2  2 

Seventh,  O  and  0  are  investigated,  and  the  extended  model  is 

B  P 


K  J 

I  e"  =  C  ,  Ee:*'=C„,  £  (e‘  +  e'.'  +  e!  V)  -  0 

jk  1  13  2  lk  3k  13 


...  =  (p.  +  or. )  +b.  +c..+e...  +  e '  +e!'+e!V, 

13k  1  3  13  13k  1k  3k  13 


where 


(6) 


(7) 


(8) 


b  e '  -  C. , 

k-1  3k  1 


£  e: 


j=i 


t«f  B  r 

ij  C2 


for  all  i,j.  Model  (8)  is  an  extension  of  model  (7) . 

2 

Eighth,  the  and  0 are  investigated  and  the  extension  is 

y  =  (p  +  or.)  +  b.  +  c.  .  +  e.  +  e!,  +  e! '  +  e!  *. ' , 
ijk  1  3  i3  iDk  lk  3k  13 

where 


(9) 


£  (e!.  +  '  +  e!") 

k-1  lX  13 


for  all  i,  j.  Model  (9)  is  an  extension  of  model  (7) . 
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2 

Ninth,  only  0  is  investigated  and  the  extended  model  is 
e 

y.  -  +  a.)  +  b.  +  c.  .  +  e.  ..  +  e'  +  e*  ’  +  e! ' ' .  (10) 

13k  i  3  13  13k  ik  3k  13 

Model  (10)  is  an  extension  of  all  of  models  (2)  -  (9) . 

Tenth,  and  last,  one  or  more  of  the  are  investigated  and  the  extension  is 

y.  ..  *  (H  +  a.)  +  b.  +  c.  .  +  e.  ..  +  e*  (11) 

13k  1  3  13  13k  13k 

where 


£  e*  “  0 

k-1  ljk 

for  all  i,  j.  Model  (11)  is  an  extension  of  model  (9) . 

3,  Basis  for  Investigation  Procedures 

Limitation  to  ten  extensions  is  largely  due  to  the  forms  that  occur  for  extend- 

2  2 

ed  models.  For  example,  an  extension  for  investigating  the  ,  and  0^  is  of 

the  same  form  as  that  for  also  investigating  the  a^,.  Thus,  no  model  is  stated 

2  2 

for  investigation  of  the  a. ,  O  ,  and  (J  .  Also,  consideration  is  limited  to  com- 

1  B  e 

binations  of  parameter  types  that  are  meaningful  for  investigation  using  the 

/  2  2 
Scheffe  mixed  model.  For  example,  consideration  of  CT  and/or  a  is  not  appro- 

B  AB 

priate,  since  the  statistic  for  investigating  0^  is  needed.  Thus,  the  parameter 

2  2  2 

0  is  included  in  any  set  containing  C_  and/or  o  _  . 
e  B  AB 

Except  in  one  respect,  the  investigation  procedures  considered  are  those 
developed  by  Scheffe  (1956)  and  (1959) .  The  one  difference  is  that  the  statistic 


I  J  K 


SS  =  £  £  £  (y.  .  -  y. -  ) 

e  i=l  3=1  k=l  13k  13 ■ 

used  by  Scheffe  is  replaced  by  the  statistic 


2  I  J  K  2 

s,  ■  if,  if,  kf,<y ilk  ■  yi,.  -  yi.k  -  tjk +  yi.. +  y.J. +  y..k  - »...> 
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at  all  places  where  SS  occurs.  The  only  effect  of  this  replacement  is  that  a  sum 

e 

of  squares  with  (1-1)  (J-l)  (K-l)  degrees  of  freedom  is  substituted  for  a  sum  of 
squares  with  IJ (K-l)  degrees  of  freedom.  This  change  in  degrees  of  freedom  is  un¬ 


important  unless  I  and  J  are  small.  The  generality  level  of  the  extensions  is 

2 

greatly  increased  by  using  s^  instead  of  SSg . 

2 

For  the  case  of  joint  normality,  s  has  the  same  independence  properties  with 

e 

the  other  statistics  as  does  SS  .  This  is  verified  examininc  the  correlation  pro- 

e 


perties  of  the  (y.  ,  -  y. . 

l  jk  13, 


yi.k 


y. jk  +  yi. .  +  y. j.  +  y . .k 


)  with  the 


V.. 


,  the  y 

•  J  • 


,  the  (y  -  y  ,  -  y  +  y  ),  etc. 

IJ.  •  J  •  ••• 


For  a  given  extended  model,  \erification  is  obtained  by  examining  the  statis¬ 


tics  developed  by  Scheffe  (with  SS^  replaced  by  s^  )  for  investigating  the  param¬ 
eters  considered.  It  is  easily  shown  that  in  every  case  the  additional  random 
error  terms  cancel  out  or  sum  out  in  the  statistics  of  Scheffe  (1956)  and  (1959) . 
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